REMARKS 

The title and abstract have been revised to conform more closely to the allowed 
claims. Inasmuch as 37 CFR 1.121 does not appear to prescribe how an abstract of a U.S. 
patent application is to be amended, Applicants' Attorney has utilized a reasonable technique 
to amend the abstract of the present application. 

The specification has been revised to correct various capitalization errors on pages 1, 
2, 9, and 10 and to correct a figure number on page 29. In addition, the citation information 
for the Ungerboeck "reference" on page 1 1 has been revised (a) to indicate that the 
Ungerboeck reference is actually two references and (b) to correct the title and volume 
information for the Ungerboeck "reference". 

A substantial number of revisions have been made to the specification in the course of 
prosecuting the present application, especially via the amendment submitted 15 September 
2003. A substitute specification accompanied the 15 September 2003 amendment. In the 
later amendments submitted 15 October 2003, 3 December 2003, and 10 February 2004 by 
which the specification was further revised, replacement pages were provided for insertion 
into the substitute specification to replace the so-revised pages. Further revisions have, as 
indicated above, been made to the specification via the present amendment. 

Applicants' Attorney recognizes that the PTO might encounter some difficulty in 
entering further replacement pages into the substitute specification for the present application 
or/and that submission of replacement pages for a substitute specification of a U.S. patent 
application might be inconsistent with the procedure now employed to print the ensuing U.S. 
patent. In light of these considerations, a corrected substitute specification that contains all 
the specification revisions accompanies this amendment in order to facilitate printing the 
U.S. patent that issues on the present application. Although the title has been amended, the 
corrected substitute specification employs the original title in order to make it clear that the 
enclosed corrected substitute specification corrects the substitute specification for the present 
application. 

Pursuant to 37 CFR 1.125(b), Applicants 1 Attorney states that the accompanying 
corrected substitute specification contains no new matter. Accordingly, the corrected 
substitute specification should be entered, 
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Entry of the present amendment will not entail materially added work on the 
Examiner's part. No more than a cursory review of the record will be needed. Hence, this 
amendment should be entered. 

Please telephone Attorney for Applicant(s) at 650-964-9767 if there are any 
questions. 



Respectfully submitted, 

Ronald J. Meetin 
Attorney for Applicant(s) 
Reg. No. 29,089 

210 Central Avenue 

Mountain View, CA 94043-4869 
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IN THE SPECIFICATION 

age 1, amend the paragraph beginning at line 16 as follows: 

The dramatic increase in desktop computing power driven by Intranet-based intran e t 
bas e d operations and the increased demand for time-sensitive delivery between users has 
spurred development of high-speed Ethernet LANs. 100BASE-TX Ethernet, using existing 
category-5 copper wire, and the newly developed 1000BASE-T Ethernet for gigabit/s 
Gigabit/s transfer of data over category-5 copper wire require new techniques in high speed 
symbol processing. Gigabit per second transfer can be accomplished utilizing four twisted 
pairs and a 125 megasymbol/s transfer rate on each pair where each symbol represents two 
bits. 

Page 1, amend the paragraph beginning at line 35 as follows: 

One system of transferring data at high rates is Non Return to Zero (NRZ) signaling. 
In NRZ, the symbol alphabet {A} is {-1, +1 }. A logical "1" is transmitted as a positive 
voltage while a logical "0" is transmitted as a negative voltage. At 125 M symbols/s, the 
symbol rate required for gigabit Gigabit transfer over four category-5 wires, the pulse width 
of each symbol is 8 ns. 

Page 2, amend the paragraph beginning at line 7 as follows: 

Another example of a modulation method for high speed symbol transfer is MLT3 
and involves a three level system. (See American National Standard Information System, 
syst e m, Fibre Distributed Data Interface (FDDI) -Part: Token Ring Twisted Pair Physical 
Layer Medium Dependent (TP-PMD), ANSI X3.263:199X). The symbol alphabet for MLT3 
is {A}={ -1, 0, +1 }. In MLT3 transmission, a logical 1 is transmitted by either a -1 or a +1 
while a logic 0 is transmitted as a 0. A transmission of two consecutive logic "l"s does not 
require the system to pass through zero in the transition. A transmission of the logical 
sequence ("1", "0", "1") would result in transmission of the symbols (+1, 0, -1) or (-1, 0, +1), 
depending on the symbols transmitted prior to this sequence. If the symbol transmitted 
immediately prior to the sequence was a +1, then the symbols (+1, 0, -1) are transmitted. If 
the symbol transmitted before this sequence was a -1, then the symbols (-1, 0, +1) are 
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transmitted. If the symbol transmitted immediately before this sequence was a 0, then the 
first symbol of the sequence transmitted will be a +1 if the previous logical "1" was 
transmitted as a -1 and will be a -1 if the previous logical "1" was transmitted as a +1 . 

Page 9, amend the paragraph beginning at line 28 as follows: 

To achieve one gigabit per second communications, a Gigabit Ethernet gigabit 
e th e rn e t transceiver needs to achieve a throughput of 250 Megabits per second over each of 
four transport wires 103-1 through 103-4. Therefore, at a 125 MHz baud rate, two bits must 
be transmitted at each sample time across each wire of cable 103. Although a PAM-5 system 
is applicable, a four level PAM system, for example, does not provide redundancy which 
allows for error correction coding necessary to achieve a bit error rate (BER) of 10" 10 , as 
required by the Gigabit Ethernet standard. See Gigabit Standard. 

Page 10, amend the paragraph beginning at line 3 as follows: 

In addition, extra channel symbols are needed to represent Ethernet e th e rn e t control 
characters. Therefore, five level PAM (PAM-5) with either a parity check code or trellis 
coding is often utilized in Gigabit Ethernet transmission. According to the Gigabit Standard, 
standard, the trellis code is the only coding utilized. Alphabets having more than five level 
1-D symbols may also be utilized for gigabit Gigabit transmission while achieving the 
required BER. 

Page 11, cancel the revision made to the paragraph beginning at line 3 via the Amendment 
submitted 15 September 2003 and, in place of that revision, amend the paragraph beginning 
at line 3 as follows: 

Trellis encoding in a conventional 4-D eight state code is described in Part II, Table 
IV of G. Ungerboeck, "Trellis-Coded "Ung e rboeck Cod e d Modulation with Redundant 
Signal Sets, Part I: Introduction", IEEE Communications Mag., vol. 25, no. 2, pp. 5 - 1 1, 
February 1987, and "Trellis-Coded Modulation with Redundant Signal Sets, Part II: State of 
the Art", IEEE Communications Mas., vol. 25, no. 2, pp. 12 - 21, February 1987 Part I and 
H", IEEE Communications, vol. 24, no. 2, pp. 5 21 (Feb., 1987) (hereinafter collectively 

2004-12-20TextAmend.doc - 3 - Appfrl. No.: 09/560,109 



" Ungerboeck"). Ung e rbo e ch"), An embodiment of an eight state trellis encoder 200 similar 
to that described in Ungerboeck is shown in Figure 2. Trellis encoder 200 receives eight bits, 
bits 0 through 7, and outputs 9 bits, bits 0 through 7 plus a parity bit, provided that 
TX_CODING is set to 1. The parity bit is produced from a rate 2/3 memory 3, systematic 
convolutional encoder 201. 

Page 29, cancel the revisions made to the paragraph beginning at line 26 via the 15 
September 2003 Amendment and, in place of those revisions, amend the paragraph beginning 
at line 26 as follows: 

Figure 9 shows the equalization and decoder sections (see, for example, equalizers 
sec Equaliz e rs 505-1 through 505-N 505 4 and decoder 507 of Figure 5 A for the case in 
which N is 4) Figur e 5, for e xampl e ) of a 4-D receiver a 4D r e c e iver 910. The equalization is 
accomplished using four decision feedback equalizers, one for each of the four input 
channels shown. Again, one skilled in the art will recognize that a receiver can have any 
number of input channels and that a 4-D receiver is shown here for example only. In 
Figure 9, receiver 910 includes 4-D decoder 900. Although decoder 900 is shown as a parity 
Parity code decoder, it is understood that decoder 900 can be any 4-D decoder. One skilled 
in the art will recognize that 4-D decoder 900 must correct symbols within a single clock 
cycle so that the results can be fed back through feedback sections (or taps) FB taps 811-1 
through 81 1-4 to correct symbols a^i through a ^4, respectively. 



Ronald J. Meetin 
Attorney at Law 
210 Central Avenue 
Mountain View, CA 

94043-4869 
Tel.: 650-964-9767 
Fax: 650-964-9779 



Enclosed is a corrected substitute specification that incorporates all of the revisions to the 
specification. This consists of the above revisions and all the earlier revisions, i.e., those 
presented in the amendments submitted 15 September 2003, 15 October 2003, 3 December 
2003, and 10 February 2004 for revising the text, to the extent that the earlier revisions have 
not been superseded by the above revisions. The page numbers of the corrected substitute 
specification begin with the letter "C" to help distinguish the substitute specification from the 
specification as originally filed and from the substitute specification submitted with the 15 
September 2003 Amendment. Also enclosed is a marked-up version of the original 
specification annotated in accordance with 37 CFR 1.125(c) to indicate all the specification 
changes, both the above changes and the earlier-made changes. 
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DETECTOR FOR AN ETHERNET RECEIVER 

Peter J. Sallaway 
Sreen Raghavan 

5 

BACKGROUND 

1, FIELD OF THE INVENTION 

10 • This invention relates to digital communication 

systems and, more particularly, to a detection system 
and method for an Ethernet receiver. 

2. DISCUSSION OF RELATED ART 

15 

The dramatic increase in desktop computing power 
driven by Intranet -based intranet - based operations and 
the increased demand for time-sensitive delivery 
between users has spurred development of high-speed 

20 Ethernet LANs. 100BASE-TX Ethernet, using existing 
category-5 copper wire, and the newly developed 
1000BASE-T Ethernet for gigabit/s Gigabit/o transfer of 
data over category-5 copper wire require new techniques 
in high speed symbol processing. Gigabit per second 

25 transfer can be accomplished utilizing four twisted 

pairs and a 125 megasymbol/s transfer rate on each pair 
where each symbol represents two bits. 

Physically, data is transferred using a set of 
voltages where each voltage represents one or more bits 

30 of data. Each voltage in the set is referred to as a 
symbol and the whole set of voltages is referred to as 
a symbol alphabet. In gigabit transfer, for example, 
data is usually sent with a set of five voltage levels 
(PAM-5), each symbol representing two (2) bits. 

35 One system of transferring data at high rates is 

Non Return to Zero (NRZ) signaling. In NRZ, the symbol 
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alphabet {A} is {-1, +1}. A logical "1" is transmitted 
as a positive voltage while a logical w 0" is 
transmitted as a negative voltage. At 125 M symbols/s, 
the symbol rate required for gigabit Gigabit transfer 
5 over four category-5 wires, the pulse width of each 
symbol is 8 ns. 

Another example of a modulation method for high 
speed symbol transfer is MLT3 and involves a three 
level system. (See American National Standard 

10 Information System, system, Fibre Distributed Data 
Interface (FDDI) -Part: Token Ring Twisted Pair 
Physical Layer Medium Dependent (TP-PMD) , ANSI 
X3.263: 199X) . The symbol alphabet for MLT3 is {A}={ - 
1, 0, +1}. In MLT3 transmission, a logical 1 is 

15 transmitted by either a -1 or a +1 while a logic 0 is 
transmitted as a 0. A transmission of two consecutive 
logic xx l"s does not require the system to pass through 
zero in the transition. A transmission of the logical 
sequence ("1", "0", "1") would result in transmission 

20 of the symbols (+1, 0, -1) or (-1, 0, +1), depending on 
the symbols transmitted prior to this sequence. If the 
symbol transmitted immediately prior to the sequence 
was a +1, then the symbols (+1, 0, -1) are transmitted. 
If the symbol transmitted before this sequence was a 

25 -1, then the symbols (-1, 0, +1) are transmitted. If 

the symbol transmitted immediately before this sequence 
was a 0, then the first symbol of the sequence 
transmitted will be a +1 if the previous logical "1" 
was transmitted as a -1 and will be a -1 if the 

30 previous logical "1" was transmitted as a +1. 

The detection system in the MLT3 standard needs to 
distinguish between 3 voltage levels, instead of two 
voltage levels in a more typical two level system. The 
signal to noise ratio required to achieve a particular 

35 bit error rate is higher for MLT3 signaling than for 
two level systems. The advantage of the MLT3 system, 
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however, is that the energy spectrum of the emitted 
radiation from the MLT3 system is concentrated at lower 
frequencies and therefore more easily meets FCC 
radiation emission standards for transmission over 
5 twisted pair cables. Other communication systems may 
use a symbol alphabet having more than two voltage 
levels in the physical layer in order to transmit 
multiple bits of data using each individual symbol. 

In Gigabit Ethernet over twisted pair Category-5 

10 cabling, for example, PAM-5 data can be transmitted 
over four twisted copper pairs pair at an individual 
twisted pair baud rate of 125 Mbaud. In PAM-5, data is 
sent with 5 voltage levels, designated as symbol 
alphabet {A}= {-2, -1, 0, 1, 2} although the actual 

15 voltage levels may be different from those. Each 

symbol, therefore, can be used to code more than one 
bit of data. 

Any other modulation scheme for symbol coding can 
be utilized, including quadrature amplitude modulation 

20 (QAM) . In QAM schemes, for example, the symbols are 
arranged on a two-dimensional (real and imaginary) 
symbol constellation constellations (instead of the 
one-dimensional one - dimension constellations of the 
PAM-5 and €Hr MLT-3 symbol alphabets) . 

25 There is a need for transmitters and receivers for 

receiving transmission over multiple twisted copper 
pairs pair using larger symbol alphabets (i.e., 3 or 
more symbols) . There is also a need for transceiver 
(transmitter/receiver) systems that, while operating at 

30 high symbol rates, have low bit error rates. 



SUMMARY 



Accordingly, a recei 
35 receiving transmission of 
using encoded data symbol 



er and detection method for 
data over multiple wires 
schemes having multiple 
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symbols is described. A receiver according to the 
present invention includes multiple detectors for 
detecting one symbol from each of the multiple wires 
simultaneously (i.e., multiple 1-D detectors), an 
5 equalizer coupled to each of the detectors for 

equalizing the symbol stream from each of the multiple 
wires, and a multi-dimensional error analyzer/decoder 
for simultaneously making hard decisions decision 
regarding the symbol output of the symbols transmitted 

10 over each of the multiple wires. 

Individual symbols can have any modulation scheme, 
including those with multi-dimensional constellations. 
The terminology of detecting N-dimensional (N-D) 
symbols refers to the number of individual symbols 

15 detected in each clock cycle, and not to the dimension 
of the symbol constellation. 

Each of the equalizers can be any equalizer 
structure, including linear or decision feedback 
equalizers. In one embodiment of the invention, the 

20 equalizers include sequence detection equalizers. In 
another embodiment of the invention, the equalizers 
include simplified decision feedback equalizers. 

In another embodiment, the equalizer includes a 
sequence detection equalizer in combination with a 

25 linear equalizer or a decision feedback equalizer. In 
some embodiments, the sequence detection equalizer is a 
reduced state sequence detector. In some embodiments, 
the decision feedback equalizer is a simplified 
decision feedback equalizer. 

30 In general, a transceiver according to the present 

invention can utilize any symbol alphabet. In some 
embodiments, a PAM-5 symbol alphabet is utilized. 

Some embodiments of the invention can also include 
an error analysis decoder. The receiver receives 

35 signals from N individual wires and, for each wire, 

includes a linear equalizer in combination with a one- 
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dimensional (1-D) a— 4 — D sequence detector. The N 
output signals from the N 1-D sequence detectors are 
input to a N-D decoder that makes a final decision on 
the N-D symbol. In some embodiments of the invention, 
5 the error analysis decoder operates with lattice 

encoding schemes. In some other embodiments of the 
invention, the error analysis decoder operates with a 
parity encoding scheme. 

These and other embodiments of a transceiver 
10 system according to the present invention are further 
described below with reference to the following 
figures . 

BRIEF DESCRIPTION OF THE FIGURES 

15 

Figure 1 shows a block diagram of a transceiver 
having multiple transport channels. 

Figure 2 shows a block diagram of an encoder 
capable of both trellis encoding and parity encoding. 
20 Figure 3 shows a trellis diagram for state 

transitions among subsets of PAM-5 four-dimensional 
(4-D) symbols. 4 D symbols. 

Figure 4 shows a block diagram of a model of 
transmission channel between a transmitter and a 
25 receiver system. 

Figure 5A shows a block diagram of a N-D receiver 
system according to the present invention. 

Figure 5B shows a block diagram of a receiver 
according to the present invention for the N-D receiver 
30 system of Figure 5A. 

Figure 6 shows a block diagram of a linear 
equalizer . 

Figure 7 shows a block diagram of the equalizer 
and decoder portions of a 4-D receiver system that 
35 includes linear equalizers and parity encoding. 
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Figure 8 shows a block diagram of a decision 
feedback equalizer . 

Figure 9 shows a block diagram of the equalizer 
and decoder portions of a 4-D receiver system that 
5 includes decision feedback equalization. 

Figure 10 shows a block diagram of a 4-D receiver 
system that includes sequence detection equalizers. 

Figure 11A shows a block diagram of a sequence 
detector . 

10 Figure 11B shows a block diagram of an embodiment 

of an equalizer system. 

Figure 12 shows an example of a trellis diagram 
for state transitions between PAM-5 symbols. 

Figure 13 shows a block diagram of an embodiment 
15 of a sequence detector equalizer with decision feedback 
according to the present invention. 

Figure 14 shows a block diagram of an embodiment 
of a sequence detector equalizer having soft outputs 
according to the present invention. 
20 Figure 15 shows a block diagram of an embodiment 

of a parity code receiver that includes soft output 
sequence detection equalizers according to the present 
invention . 

Figure 16 shows an embodiment of a reduced 
25 complexity sequence detector having soft outputs 
according to the present invention. 

Figure 17 shows an example of a trellis diagram 
illustrating state changes between reduced states of a 
reduced complexity sequence detector, including 
30 multiple branches between states. 

Figure 18 shows a trellis diagram illustrating 
state changes between the reduced states of a reduced 
complexity sequence detector after branch path 
decisions have been made. 
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Figure 19 shows a block diagram of a decision 
feedback equalizer having a simplified feedback section 
according to the present invention. 

Figure 20A shows a sequence detector in 
5 combination with a decision feedback equalizer. 

Figure 20B shows an embodiment of the feedback 
section of the decision feedback equalizer shown in 
Figure 20A that includes a simplified feedback section. 

In the figures, components having similar 
10 functions are often labeled similarly. 



DETAILED DESCRIPTION 

15 

Figure 1 shows a block diagram of a transceiver 
system 100 according to the present invention. 
Transceiver system 100 includes transmitter 101, 
receiver 107, and transport wires 103-1 through 103-N. 

20 A digital data stream is input to transmitter 101 by a 
first host 150. Transmitter 101 includes encoder 102, 
which encodes the data for transmission over transport 
wires 103-1 through 103-N. Transmission coupler 112 
couples the encoded symbols received from encoder 102 

25 to transmission channel 104. Data is output by 

transmission coupler 112 as symbols a^i through ak,N 
over wires 103-1 through 103-N (collectively 103 - N, 
(collectively referred to as cable 103) , respectively, 
which are coupled between transmitter 101 and receiver 

30 system 107. Wires 103-1 through 103-N can be of any 
transport medium or combination of transport media. 
Transport media include, for example, category-5 
twisted copper pair, optical fiber and coax cable. 

The index k in the above notation indicates the 

35 kth time cycle of the data transmission. The indicator 
N is an integer indicating the number of individual 
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transport wires in cable 103. In general, any number 
of wires can be included in transceiver system 100. 
For gigabit transmission, N is usually four (4), 
indicating a four wire connection between transmitter 
5 101 and receiver system 107. Wires 103-1 through 103-4 
are often twisted copper pair. 

Transmission channel 104 collectively represents 
cable 103 and any distortion of the signals that occurs 
between transmitter 101 and a receiver 107. Each of 

10 wires 103-1 through 103-N, along with output couplers 
of coupler 112 and input couplers of detector 108, 
distorts distort signals as indicated by the associated 
transmission channel 104-1 through 104-N, respectively. 
The signals through wires 103-1 through 103-N are 

15 distorted by channel functions fi(Z) through f N (Z), 
respectively, and additionally suffer from a random 
noise addition n k/i through n k/N , respectively. Receiver 
107 includes signal includes a signal detector 108 and 
a decoder 109 and ultimately outputs a data stream 

20 which corresponds to the data stream entering 
transmitter 101. 

In Gigabit Ethernet, transmission can be conducted 
on four twisted copper pairs (i.e., wires 103-1 through 
103-4 in Figure 1) in a full duplex fashion to achieve 

25 one gigabit per second throughput. See IEEE 802. 3ab, 
Gigabit Long Haul Copper Physical Layer Standards 
Committee, 1997 (hereinafter "Gigabit Standard") . 
Transmitter 101 is coupled . to first to a first host 150 
to receive data for transmission over transmission 

30 channel 104 to a second host 151 coupled to receiver 

107. In general, first host 150 is further coupled to 
a receiver 111 for receiving data from transmission 
channel 104 and second host 151 is coupled to a 
transmitter 110 for sending; data to transmission 

35 channel 104. 
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Although, in general, the detection system as 
described here is applicable to any scheme of data 
transmission (i.e., any symbol alphabet) over any 
number of transport wires (e.g., twisted copper pair), 
5 for exemplary purposes many of the examples below 
specifically describe a PAM-5 symbol alphabet 
transmitted over four twisted copper pairs , pair, as 
would be used in Gigabit Ethernet transmission over 
Category-5 twisted pair cabling. It should be 
10 recognized that other symbol alphabets and numbers of 

conductors can also be used and that one skilled in the 
art will recognize from this disclosure embodiments 
appropriate for other modulation schemes. 

15 

Encoder 

According to the developed IEEE 802. 3ab standard 
for Gigabit Ethernet transmission, the transmitted 

20 symbols on each of four conductors 103-1 through 103-4 
are chosen from a five level Pulse Amplitude Modulation 
(PAM-5) constellation, with alphabet {A}={-2, -1, 0, 
+1, +2}. See Gigabit Standard. At each clock cycle, a 
single one-dimensional (1-D) symbol is transmitted on 

25 each wire. The four 1-D symbols, one on each of 
conductors 103-1 through 103-4, transmitted at a 
particular sample time k are -kr — i-s- considered to be a 
single 4-D symbol. In general, data entering 
transmitter 101 can be encoded into a N-D symbol, 

30 instead of into N 1-D symbols, by encoder 102. Encoder 
102 may be any type of N-D encoder, including a N-D 
parity code encoder and a N-D trellis code encoder. 

To achieve one gigabit per second communications, 
a gigabit ethernet transceiver needs to achieve a 

35 throughput of 250 Megabits per second over each of four 
transport wires 103-1 through 103-4. Therefore, at a 
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125 MHz baud rate, two bits must be transmitted at each 
sample time across each wire of cable 103. Although a 
PAM-5 system is applicable, a four level PAM system, 
for example, does not provide redundancy which allows 
5 for error correction coding necessary to achieve a bit 
error rate (BER) of 10~ 10 , as required by the Gigabit 
Ethernet standard. See Gigabit Standard. 

In addition, extra channel symbols are needed to 
represent Ethernet cthcrnct control characters. 

10 Therefore, five level PAM (PAM-5) with either a parity 
check code or trellis coding is often utilized in 
Gigabit Ethernet transmission. According to the 
Gigabit Standard, standard, the trellis code is the 
only coding utilized. Alphabets having more than five 

15 level 1-D symbols may also be utilized for Gigabit 

Gigabit transmission while achieving the required BER. 

At 125 Mbaud, each 4-D symbol needs to transmit at 
least eight bits. Therefore, 256 different 4-D symbols 
plus those required for control characters are 

20 required. By transmitting a 4-D PAM-5 symbol alphabet, 
there are 5 4 = 625 possible symbols. This number of 
symbols allows for 100% redundancy in the data as well 
as for several control codes. Symbol alphabets having 
more than five symbols yield even greater redundancy. 

25 However, because of the difficulties in distinguishing 
between the higher number of voltage levels, higher 
error rates may be suffered in receiver detection 
systems, such as detector 108 of Figure 1. 

The Gigabit Ethernet standard (see Gigabit 

30 Standard) -, — Sec Gigabit Standard, allows a trellis 

code. However, both a 4-D eight state trellis code and 
a 4-D parity code have been proposed. The trellis code 
achieves 6dB of coding gain over uncoded PAM-5 while 
the parity code achieves 3dB of coding gain. While 

35 encoding, the choice between encoders can be encoded in 
a TX_CODING bit, which can be set to one for trellis 
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coding. One skilled in the art will recognize that 
embodiments of the present invention are applicable to 
any error correction technique. 

5 

4-D Trellis 4D Troll is Encoding 

Trellis encoding in a conventional 4-D eight state 
code is described in Part II, Table IV of G. 

10 Ungerboeck, "Trellis-Coded "Ungcrbocck - Codcd Modulation 
with Redundant Signal Sets, Part I: Introduction", IEEE 
Communications Mag., vol. 25, no. 2, pp. 5 - 11, 
February 1987 and "Trellis-Coded Modulation with 
Redundant Signal Sets, Part II: State of the Art", IEEE 

15 Communications Mag., vol.25, no. 2, pp. 12 - 21, 

February 1987 Part I and II", — IEEE Communications , — vol . 
24, no. 2, pp. 5 ' 21 — (Feb., 1987) (hereinafter 
collectively " Ungerboeck" ) . Ungcrbooch" ) . An 
embodiment of an eight state trellis encoder 200 

20 similar to that described in Ungerboeck is shown in 
Figure 2. Trellis encoder 200 receives eight bits, 
bits 0 through 7, and outputs 9 bits, bits 0 through 7 
plus a parity bit, provided that TX_CODING is set to 1. 
The parity bit is produced from a rate 2/3 memory 3, 

25 systematic convolutional encoder 201. 

Convolutional encoder 201 includes delays 202, 204 
and 206, each of which delays its input signal by one 
clock cycle. The output signal from delay 202 is XORed 
(exclusive-ORed) with bit 6 in XOR 203 and input to 

30 delay 204. The output signal from delay 204 is XORed 
with bit 7 in XOR 205 and input to delay 206. The 
output signal from delay 206 is input to AND gate 207 
and input to delay 202. AND gate 207 generates the 
parity bit, which is one (1) if TX_CODING is one (1) 

35 and the output signal from delay 206 is 1, and zero 
otherwise. In embodiments that only utilize trellis 
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coding (i.e., TX_CODING is always 1), AND gate 207 may 
be excluded from encoder 200 and the parity bit is the 
output signal from convolutional encoder 201. 

The two input bits to convolutional encoder 201 
5 (bits 6 and 7) , and the parity bit produced by encoder 
201 select one of eight subsets, DO through D7, of the 
4-D symbol alphabet. The nine output bits are mapped 
to one 4-D PAM-5 symbol that is then transmitted across 
cable 103 (Figure 1) as four 1-D PAM-5 symbols. 

10 Each 1-D PAM-5 symbol is a member of one of two 

families, X (odd) and Y (even) . The odd set X contains 
the PAM-5 symbols {-1, +1} and the even set Y contains 
the PAM-5 symbols {-2, 0, +2}. Table 1 shows a 
definition of the eight subsets of 4-D symbols labeled 

15 DO -DO through D7 . The definition is based on the 

membership of 1-D PAM-5 symbols that are represented in 
each subset. Table 1 also shows the number of 4-D 
symbols included in each of the subsets. 

The notation describing each subset indicates the 

20 families of 1-D PAM-5 symbols on each of the four wires 
describing membership in that subset. The notation 
XXYX, for example, indicates a set of four 1-D PAM-5 
symbols where the first symbol is from type X, the 
second symbol is from type X, the third symbol is from 

25 type Y, and the fourth symbol is from type X. 

Therefore, conductor 103-1 (Figure 1) carriers a symbol 
of type X, conductor 103-2 carries a symbol of type X, 
conductor 103-3 carries a symbol of type Y and 
conductor 103-4 carries a symbol of type X. 

30 

Table 1 Mapping of 4-D symbols into sets DO through 
D7 



Subset 


X Primary Code 


Y Primary Code 


# of 
Symbols 


DO 


XXXX 


YYYY 


97 


Dl 


XXXY 


YYYX 


78 
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D2 


XXYY 


YYXX 


72 


D3 


XXYX 


YYXY 


78 


D4 


XYYX 


YXXY 


72 


D5 


XYYY 


YXXX 


78 


D6 


XYXY 


YXYX 


72 


D7 


XYXX 


YXYY 


78 



The parity bit and bits 6 and 7 are input to set 
select 210 (Figure 2) . Set select 210 determines a 
particular subset selection p, indicating that subset D P 
5 of subsets D 0 through D 7 has been selected. In one 

embodiment, subset selection p is determined according 
to the formula 



p = 4*BIT6 + 2*BIT7 + l*Parity, (1) 

10 where BIT6 is bit 6, BIT7 is bit 7, and Parity is the 
parity bit. 

A point within subset p is chosen by the six least 
significant bits of the input, bits 0 through 5. Bits 
0 through 5 are input to a 4-D PAM-5 mapper 211 along 

15 with the output x output of set select 210 . 210 , — jf-r- 4- 
D PAM-5 mapper 211 determines the 4-D PAM-5 symbol 
within set D p which represents the eight input bits, 
bits 0 through 7, and the parity bit. Each subset, E>0 
through D7 , contains more than the 64 points 

20 required to encode the six bits, bits 0 through 5. 
These additional points are either used as control 
characters or not used at all. 

The subset mapping shown in Table 1 is chosen such 
that the squared Euclidean distance between any pair of 

25 points in the same subset is greater than or equal to 
four (4). For example, the squared distance between 
two points in subset DO can be expressed as (Xn-X^) **2 
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+ (X 2 i-X 22 )**2 + (X 3 i-X 32 )**2 + (X 4 i-X 42 ) **2. Because X ±j = 
+ 2, 0, or -2, the shortest squared distance is (2-0) **2 
= 4, which occurs when only one value differs between 
the two points. In addition, the squared Euclidean 
5 distance between points in different even subsets is 
greater than or equal to 2 and the squared Euclidean 
distance between points in different odd subsets is 
greater than or equal to 2 . As also can be seen from 
Table 1, even numbered subsets (D 0/ D 2 , D 4 , D 6 ) have an 

10 even number of symbols of type X and an even number of 
symbols from type Y while odd numbered subsets (Di, D 3 , 
D 5 , D 7 ) have an odd number of symbols of type X and an 
odd number of symbols of type Y. 

Figure 3 shows a trellis diagram resulting from 

15 the convolutional encoder shown in Figure 2. The 

states of the trellis in Figure 3, S 0 through S 7 , are 
determined by the bits in delay elements 202, 204 and 
206. The state S q is determined by q=4*(the output 
signal from delay 202) +2* (the output signal from delay 

20 204) + l*(the output bit from delay 206). The subsets 
Dp are determined by the transition from one state to 
another as shown in Figure 3. The subsets oubocpt o D p 
are given in Table 1 

As shown in Figure 3, all transitions out of a 

25 particular state are either all even subsets subotatca 
(Do, D 2 , D 4 , and D 6 ) or all odd subsets (Di, D 3 , D 5 , and 
D 7 ) . Similarly, the transitions into a particular state 
are either all even subsets or all odd subsets. The 
minimum squared distance between outgoing transitions, 

30 therefore, is equal to two (2) and the minimum squared 
distance between incoming transitions is also two (2) . 

As a result, the minimum squared distance between 
valid sequences is greater than or equal to 4, which 
can be seen from the fact that any two paths that 

35 originate from the same node and end at the same node, 
but diverge at some point in the middle, must then 
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converge at a later time. Both the divergence and the 
convergence have a squared distance of at least 2, thus 
the total squared distance must be at least 4. In the 
case where these two paths do not diverge, then they 
5 must contain different points from the same subset. 

Because the minimum squared distance between points in 
the same subset is equal to 4, the minimum squared 
distance between valid sequences is 4. As is 
conventionally known, therefore, a coding gain of 6dB 
10 with respect to uncoded PAM-5 constellations is 
therefore arc experienced. 

4~D Parity Code 4D Parity coda 

15 

The 4-D parity code can also be transmitted using 
the same encoder, encoder 200 of Figure 2. To do so, 
the TX_CODING bit is set to zero. As a result, the 
parity bit produced by convolutional encoder 201 is 
20 always 0. Therefore, set select 211 always chooses 
even subsets (i.e., X=0, 2, 4 or 6) . The minimum 
squared Euclidean distance between any two 4-D symbols, 
therefore, is 2 and a coding gain of 3dB is experienced 
over uncoded PAM-5. 

25 

Transmitter Coupler 

Transmitter coupler 112 (Figure 1) couples the N-D 
symbol from encoder 102 to transmission channel 104. 

30 In some embodiments, coupler 112 can include pre-coding 
of signals to each of lines 103-1 through 103-N. Some 
pre-coding may at least partially overcome the expected 
intersymbol interference effects experienced in 
transmission channels 104-1 through 104-N, 

35 respectively. However, some pre-coding, such as partial 
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response shaping, for example, may actually acid to the 
intersymbol interference effects. 

Coupler 112 converts symbols received from encoder 
102 to appropriate voltages for transmission to 
5 receiver 107 through transmission channel 104. In many 
embodiments of PAM-5 transmission, for example, those 
voltages are (-1, -1/2, 0, +1/2, +1) volts 
corresponding to the PAM-5 symbols (-2, -1, 0, 1, 2), 
respectively . 

10 

Transmission Channel Characteristics 

An input symbol stream {a k ,i} through {a k , N } is 
input to each of wires 103-1 through 103-N, 

15 respectively, of transmission channel 104 (Figure 1) by 
transmitter 101. Wires 103-1 through 103-N can be 
twisted copper pair, or some other transmission medium 
such as coaxial cable or optical fiber. Transmission 
channel 104 represents the .effects that wires 103-1 

20 through 103-N, transmission coupler 112 and receiver 
couplers in detector 108 have on the input symbol 
streams {a k ,i} through {a k/N } in -fa^ ] in transmission 
between transmitter 101 and receiver 107. Each 
transmission channel 104-1 through 104-N includes a 

25 corresponding one of wires .103-1 through 103-N, 

respectively, for the symbol stream {a k/ i} through 
{a k , N , } respectively. 

Figure 4 shows a single transmission channel 104-L 
that represents the Lth one of transmission channels 

30 104-1 through 104-N, where L can be any one of 1 

through N. The symbol a k/L , representing the symbol 
transmitted on wire 103-L in the kth time period, is 
transmitted through transmission channel 104-L. The 
symbol stream {a k/L } of Figure 4 can be NRZ, MLT3, PAM-5 

35 or any other symbol alphabet and modulation. The 

transmitted symbols in the sequence {a k/L } are members 
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of the symbol alphabet {A} . In the case of five-level 

PAM signaling, the symbol alphabet {A} is given by {-2, 

-1, 0 +1, +2} . 

The channel response 105-L is represented by the 

5 channel function f L ( Z ) ■ # fc (z) . In Figure 1, each of 

conductors 103-1 through 103-N can experience a 

different channel function fi(Z) through f N (Z), 

respectively. The addition of random noise n k/L in 

Figure 4 is represented by adder 106-L. Again, in 

10 Figure 1 each of conductors 103-1 through 103-N 

experiences a different random noise n kfl through n k/N , 

respectively. The signal oignal, x kfL suffering from 

channel distortion, random noise, and a flat signal 

loss looo , is received by receiver by a receiver 107. 
15 For the sake of simplicity, a baseband 

transmission system is assumed, although the techniques 

shown are easily extended to a passband transmission 

system. (See E.A. Lee and D.G. Messerchmitt, Digital 

Communications (1988)) It is also assumed that the 

20 channel model includes the effects of transmit and 
receive filtering. In addition, the transmission 
channel is assumed to be linear in that two overlapping 
signals simply add as a linear superposition. The Z- 
transf orm Z-tranof arm, (see A. V. Oppenheim & R. W. Schafer, 

25 Discrete-Time Signal Processing (1989) ) (1989) ) , of the 

sampled transmission channel 104-L shown in Figure 4 is 
given by the channel function polynomial 

f L (Z)=fo,L + fi, L Z -1 + . . . fj,LZ" j + . . . + f R/L Z" R , (2) 

where fo,Lf fj,L, f r, l are the polynomial 

30 coefficients. The coefficient f j/L represents the 

dispersed component of the (k-j)th symbol present in 
the a k/L th symbol and R is a cut-off integer such that 
fj, L for j>R is negligible. The polynomial f L (Z) 
represents the Z-transf ormation of the frequency 
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response of the transmission channel (Z _1 represents a 

one period delay) . (See A. V. Oppenheim & R. W. Schafer, 

Discrete-Time Signal Processing (1989) . ) (1989) ) . 

The noiseless output of the channel at sample time 

5 k is given by 

r k , L = fo,L * a k , L + fi,L * a k _i, L + . . - f R , L * a k _ R , L , (3) 

where, without loss of generality, f 0 ,L can be assumed 
to be 1. Thus, the channel output signal at time k 
depends, not only on transmitted data at time k, but on 

10 R past values of the transmitted data. This effect is 
known as "intersymbol interference" (ISI). (See Lee & 
Messerschmitt. ) Mesoersciimitt) . The ISI length of the 
transmission channel defined by Equations 2 and 3 is R, 
the number of past symbols contributing to ISI. 

15 Intersymbol interference is a result of the 

dispersive nature of the communication channel. The 
IEEE LAN standards require that systems be capable of 
transmitting and receiving data through at least a 100 
meter cable. In many instances, a single symbol may 

20 affect symbols throughout the transmission cable. 
The noise element of the input signal is 
represented by the sequence {n k/L }. Therefore, the 
noisy output signal from transmission channel 104-L is 
given by 

25 

x k/L =r k , L + n k , L , (4) 

where the noise samples {n k/L } are assumed to be 
independent and identically distributed Gaussian random 
30 variables (see Lee & Messerschmitt) with variance equal to 
a 2 . 

Receiver 

35 
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Figure 5A shows a shows — in a block diagram of an 
embodiment of a baseband receiver system 500 according 
to the present invention. Other receiver systems may 
also utilize aspects of the present invention. 
5 Embodiments of receiver system 500 may include any 
number of transport wires 103-1 through 103-N (with 
associated transmission channels 104-1 through 104-N, 
respectively) carrying input signal streams x k ,i through 
x k/N , respectively . 

10 Receiver system 500 includes receivers 501-1 

through 501-N, one for each of lines 103-1 through 103- 
N, respectively. Receiver 501- j, an arbitrarily chosen 
one of receivers 501-1 through 501-N, includes 
f ilter/digitizer 502-j, equalizer 505-j, and 

15 coefficient update 506-j . Signal x k/ -j from wire 103-j 
is received by filter /digitizer 502-j . Signals — from 
wire — 103 - j , — ^^.7 — arc received by filter digitizer 502 

Filter/digitizer 502-j filters, digitizes and 
amplifies the signal x k ,j and outputs a signal y k ,j- 

20 Equalizer 505-j receives the signal y k/ j, equalizes it 
to remove the effects of intersymbol interference, and 
outputs a signal a' k ,j, which is the output signal for 
receiver 501-j . Filter /digitizer Filter/ Digitizer 502- 
j can be arranged to include filters that partially 

25 remove the ISI interference from signal x k/j before 
digitizing the signal. See, e.g., U.S. Patent 
Application 09/561, 086, Manickam Monickam et al . , ( Sec , 
e.g., — Application Serial Mo. — [Attorney Docket No. — M— 
5789] , filed on the same date as the present 

30 application, and assigned to the same assignee a_s as — ie- 
the present application, herein incorporated by 
reference in its entirety . entirety) . 

Coefficient update 506-j inputs decided-on decided 
eft symbols a k/ j and other parameters and adaptively 

35 chooses parameters for filter/digitizer 502-j and 
equalizer 505-j (e.g., amplifier gain, multiplier 
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coefficients, filter parameters, echo cancellation, 
NEXT cancellation, and timing parameters) . 

One skilled in the art will recognize that each of 
receivers 501-1 through 501-N can be different. That 
5 is, different (i.e. , each of filter /digitizers f iltcro 
502-1 through 502-N and equalizers 505-1 through 505-N 
can be individually matched to receive input signals 
from the corresponding one of wires 103-1 through 103- 
N. 

10 Figure 5B shows a representative example of 

receiver 501-j . Receiver 501- j is one of receivers 

501- 1 through 501-N. Receiver 501-j includes filter 
digitizer (or receiver/digitizer) receiver/ digitizer 

502- j in series with equalizer 505-j . 

15 Receiver/digitizer 502-j includes, in series, 

filter/echo f iltcro/ccho canceller cancclor 508-j, 
analog-to-digital converter (ADC) 509-j, and amplifier 
510- j . One skilled in the art will recognize that the 
order of these components can be altered from that 

20 shown in Fig. 5B . For example, amplifier 510-j can be 
implemented before filter 502 — j — en? filter/echo 
canceller (or simply filter) 508-j, or filter 508-j can 
be implemented, completely or partially, digitally 
after ADC 509-j . 

25 Parameters to control the components of receiver 

501-j — j- can be adaptively chosen by coefficient 
update 506-j . Coefficient update 506-j adaptively 
determines the equalizer coefficients of equalizer 
equalizers 505-j, the gain gj of amplifier 510-j, the 

30 timing coefficient Tj of ADC 509-j, and filter 

coefficients for filter 508-j . In some embodiments, 
coefficient update 506-j can calculate a baseline 
wander correction signal w-j signal wj , which is 
subtracted from the output sample of ADC 509-j at 

35 baseline wander correction adder 511-j . Baseline 

wander correction is discussed in "Digital — Baseline 
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Wander Correction Circuit," U.S. Patent Application Ner 
09/151,525, filed September July 11, 1998, Srccn A. 
Raghavan, assigned to the same assignee as the present 
application, diocloourc, now U.S. Patent 6,415,003, 
5 herein incorporated by reference in its entirety. 

Some embodiments of receiver 501-j include a cable 
quality and length indicator 512-j that indicates a 
wire length L and wire quality Q. 

Echo noise, which is a result of impedance 

10 mismatches in the duplex link causing some of the 

transmitted signal energy to be reflected back into a 
receiver, and near end crosstalk (NEXT) noise, which is 
caused by the interference from a transmitter , i.e., 
transmitter 110 (Figure 1) , (Figure 1) physically 

15 located adjacent to receiver 107, can be canceled 
through adaptive algorithms in filter 508-j . The 
cancellation of echo noise and NEXT noise is nearly 
complete because receiver system 500 has access to the 
data transmitted by an adjacent transmitter 

20 (transmitter 110 in Figure 1). Coeff icient . update 506- 
j, therefore, may input parameters from a 
decoder/slicer , host 151 or other controller in order 
to adjust filter 508-j to cancel echo and NEXT noise. 
Note that, in Figure 1, transmitter 101 may also be 

25 adjacent to an accompanying receiver 111. 

Filter 508-j can also include an anti-aliasing 
filter. An anti-aliasing filter prevents aliasing by 
passing the input signal, received from wire 103-j, 
through a low pass filter to reject out-of-band noise. 

30 As such, any conventional anti-aliasing filter can be 
utilized as an anti-aliasing filter portion of filter 
508-j . 

The analog-to-digital converter (ADC) 509-j 
samples and holds the input signal for a duration of 
35 the symbol period T, which in one embodiment of the 
invention is 8 ns. In general, embodiments of the 
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invention can utilize any symbol period- Techniques 
for analog-to-digital conversion that can be used in 
ADC 509-j are well known. The digitized signals in the 
receiver are interchangeably referred to in this 
5 disclosure as samples or signals . 

Amplifier 510-j amplifies the samples received 
from wire 103-j through transmission channel 104-j in 
order to correct for signal loss during transmission. 
The gain gj of amplifier 510-j The gain of amplifier 

10 -54-9 — 3-, — q^-r can be adaptively chosen by coefficient 
update 506-j in order to optimize the operation of 
receiver 501-j . One of ordinary skill in the art will 
recognize that digital amplifier 510-j can be located 
anywhere in receiver 501-j -503 — j- between ADC 509-j and 

15 equalizer 505-j . In general, amplifier 510-j can also 
be an analog amplifier located anywhere between input 
channel 104-j and ADC 509-j. 

In some embodiments, coefficient update 50 6-j can 
also calculate the length and quality of wire 103-j . 

20 Cable length and quality determination is discussed in 
U.S. Patent Application Ne-r- 09/161, 346, "Cable Length 
and Quality Indicator", filed September 25, 1998, Srccn 
A-r- Raghavan et al . , and Doug J. — Eaoton, assigned to the 
same assignee as the present application, disclosure, 

25 now U.S. Patent 6,438,163, herein incorporated by 
reference in its entirety. • 

The output sample y k ,i from receiver/digitizer 502- 
2 The output — sample from receiver/digitizer 502 — j-7 — 
is input to equalizer 505-j . Equalizer 505-j can be 

30 any kind of equalizer structure. Types of equalizer 

structures include linear equalizers, decision feedback 
equalizers, and sequence detection equalizers. 
Equalizers of these types for 100 or 1000 BASE-T 
Ethernet over category-5 wiring, 24 gauge twisted 

35 copper pair, are described in "Improved Detection for 
Digital Communication Receivers," U.S. Patent 
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Application Ne-r- 08/974, 450/ filed November 20, 1997, 
Srocn A. Raghavan, assigned to the same assignee as the 
present application, now U.S. Patent 6,038,269, herein 
incorporated by reference in its entirety; and 
5 "Simplified Equalizer for Twisted Pair Channel," U.S. 
Patent Application We^ 09/020,628, filed February 9, 
1998, Srccn A. Raghavan, assigned to the same assignee 
as the present application, disclosure, now U.S. Patent 
6,115,418, herein incorporated by reference in its 

10 entirety. 

Additionally, receivers of the type described 
above as receivers 501-1 through 501-N are further 
described in U.S. Patent Applications 09/151,525 and 
09/161, 346, both cited above. Additionally, — receivers 

15 of the type described above as receivers — — 1 through 
501 - N arc — further described in "Digital Baseline Wander 
Correction Circuit," U.S. Application No. — 0 9/151, 52 5, 
filed July 11, — 1998 , — Srccn A. — Raghavan; — and U.S. — Patent 
Application No. 09/161,346, "Cable Length and Quality 

2 0 Indicator", — filed September 25, — 1998, Srccn A. 

Raghavan and Doug J. — Easton, — both of which have already 
been incorporated by reference. 

In receiver system 500. of Figure 5A, the output 
samples a' kfl through a' k#N from receivers 501-1 through 

25 501-N, respectively, the output — samples — from each of 
receivers — §-04 — 1 through 501 N, — a-h^ through a ! ^ rr are 
input to decoder 507. Decoder 507 decides on a N-D 
symbol based on the samples from each of receivers 501- 
1 through 501-N. Each of the N 1-D symbols of the N-D 

30 symbol is the result of the N-D symbol pick in decoder 
507. 

Figure 6 shows a block diagram of a linear 
equalizer 600 having R+l multipliers, where R is any 
integer greater than or equal to 0. Linear equalizer 
35 600 includes delays 601-1 through 601-R connected in 
series. The output samples from each of delays 601-1 
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through 601-R are is- also input to multipliers 602-1 

through 602-R, respectively. The input sample to 

equalizer 600 is input to multiplier 602-0. The input 

samples to multipliers 602-0 through 602-R are 

5 multiplied by the corresponding one of multiplier 

coefficients C 0 through C R , respectively, and summed in 

adder 603. Multiplier coefficients C 0 through C R can be 

adaptively chosen to optimize the performance of 

equalizer 600. In Figure 5B, for example, coefficient 

10 update 506-j adaptively chooses equalizer parameters 

for equalizer 505-j . 

Equalizer 600 (Figure 6) executes the transfer 

function 

T = C 0 + CjZ" 1 + + CjZ J + + C R Z~ R . (6) 

15 For simplicity, the wire designation L has been 

neglected. It is understood that each transmission 
channel includes a separated equalizer, each of which 
can be a unit one of equalizer 600 having its own 
transfer function T . 

20 In a zero-forcing linear equalizer (ZFLE), the 

transfer function T is the inverse of the frequency 
response of the channel f(Z) (see Equation 2 with the 
wire designation L neglected) . In a minimum mean 
squared error based linear equalizer (MMSE-LE) , the 

25 transfer function is arranged to optimize the mean 

squared error between the transmitted data signal and 
the detected data symbols. A compromise, then, is 
found between the un-canceled ISI and the noise 
variance at the output terminal of the equalizer. (See 

30 B. Sklar, Digital Communications, Fundamentals and Applications 
(PTR Prentice Hall, Englewood Cliffs, NJ, 1988) . ) 
1988) ) . 

The output sample from- linear equalizer 600, 
executing transfer function T, is given by 
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< = C 0 y k + C x y k _ x + ••• + Cjy h _j + + C R y k _ R , (7 ) 

where C 0 through C R are the equalizer coef f icients , y k _j 
is the input signal to equalizer 600 during the time 
period that is j periods before the kth period, and k 
5 represents the current time period. 

The output sample a' k from equalizer 600 The output 
sample — from equalizer — 600 , — a-*-^— is usually input to a 
slicer 604 which decides, based on its input sample a' k , 
what symbol a k was transmitted during time period k. 
10 The symbol a k is chosen from the symbol alphabet used 
for transferring data that is closest to input signal 
a k . 

A linear equalizer can be implemented using either 
parity coding or trellis coding systems. When linear 

15 equalization is used with parity coding, a separate 
linear equalizer is used on each transport wire. In 
Figure 5A, for example, each of equalizers 505-1 
through 505-N can include a linear equalizer. The 
output samples — from each of equalizers — — 1 through 

20 505 - N is input to decoder 507, — which chooses the most 
appropriate multi - dimensional — (N - D) — symbol 

As an example, Figure 7 shows a portion of a 4-D 
receiver system 710, which includes 4-D decoder 700 and 
linear equalizers 600-1 through 600-4. Linear 

25 equalizers 600-1 through 600-4 provides equalization 

for each of channels 104-1 through 104-4, respectively. 
Decoder 700 can be any type of decoder including a 
parity code decoder and a 4-D trellis decoder. As an 
example, decoder 700 is shown as a parity code decoder. 

30 Also, although a 4-D decoder is shown in Figure 7, it 
is understood that in general receiver system 710 can 
have any number of parallel input signals. 

The input samples to linear equalizers 600-1 
through 600-4 are 7 — corresponding to the output samples 

35 y k/ i through y k/4 from receivers /digitizers 
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receiver/digitizer 502-1 through 502-4 (Figure 5B) , 
which io given by through samples , 

respectively. The subscripts 1-4 reference each of the 
four wires 103-1 through 103-4, respectively. The 
5 output samples a' k ,i through a' k#4 from linear equalizers 
600-1 through 600-4, 600 - 4 are given by a 1 ~4eHr through 
a-S^— respectively, a**d are input to slicers 604-1 
through 604-4, respectively. In Figure 7, slicers 604- 
1 through 604-4 are 1-D slicers. If PAM-5 symbol 

10 coding is utilized, then slicers 604-1 through 604-4 

are 1-D PAM-5 slicers that each output the PAM-5 symbol 
closest to input sample a' k/ i through a' k/4 , respectively. 

The output symbols a kf r through a k , 4 from slicers 
604-1 through 604-4, a^ , through a^ .— respectively, are 

15 input to parity check 702. ' Additionally, each of 
samples a' k ,i through a' k , 4 is subtracted from the 
corresponding one of symbols a k ,i through a k/4 , 
respectively, in adders 701-1 through 701-4, 
respectively, to calculate errors e k/ i through e k/4 , 

20 respectively. In general 7 — then, the error signal e kfi , 
where i is 1 through 4, is then given by 



The parity of the 4-D symbol that results from the 
four 1-D symbols four ID symbols is checked in parity 

25 check 702. In parity coding, the 4-D symbol tke — 4-9 
symbol is chosen from an even subset of all 4-D 
symbols. Therefore, if PAM-5 coding is used, there are 
an even number of PAM-5 symbols from family X (odd 
symbols) and an even number* from family Y (even 

30 symbols) . Parity check 702 checks the parity of the 
four input symbols, a k ,i through a k/4 , by determining 
whether the sum of the four symbols is even or not. An 
odd parity indicates that there is an error in at least 
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one of the decided symbols a k ,i through a k , 4 . The result 
of the parity check is input to final decoder 704. 

The calculated error signals e k/ i through e k , 4 are 
input to error analysis 703. Error analysis 703 
5 determines which of the four error signals e k/ i through 
e k , 4 is greatest and the sign of that error. Error 
analysis 703 outputs a sign signal Sgn (sgn) and an 
identifier W for the symbol having the greatest error . 
error — (W) . 

10 Final decoder 704 inputs the parity signal from 

parity check 702, the four 1-D PAM-5 symbols aj^ 
through a k/4 from slicers 604-1 through 604-4, 
through a^ .— respectively, .the identifier W for the 
symbol having the greatest error 7 — Wy- and the sign Sgn 

15 of that error 7 — sgn, and outputs the PAM-5 symbols a' k ,i 
through a' k/4 in response. If the parity is even, then 
the 4-D symbol defined by 1-D symbols a' k/ i through a' k/4 
is then given by a k ,i through a k , 4 , respectively. The 
parity coding scheme, therefore, will pass erroneous 

20 4-D symbols erroneous — 4D symbols containing 

simultaneous errors in two of the 1-D symbols. 

If the parity is odd, however, the results of 
error analysis 703 are used to correct the output 
symbols. Because the symbol having the greatest error 

25 is the one that is most likely incorrect, the value of 
the symbol indicated by identifier W is corrected by 
either increasing or decreasing that symbol by one 
symbol in the symbol alphabet in response to the sign 
Sgn of the error (in this example, increased for a 

30 positive sign and decreased for a negative sign) . The 
new set of four symbols, the three uncorrected symbols 
having the lowest error and the corrected symbol, is 
output as the 4-D symbol defined by 1-D symbols a' k/ i 
through a' k ,4. 

35 Although simple to implement, the primary 

disadvantage of a linear equalizer is that, while 
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removing the ISI from the input signal, it may cause 
the random noise to be enhanced. This is especially 
true in twisted copper pair channels where the 
frequency response of the channel has significant 
5 attenuation across the transmitted signal bandwidth. 
Hence, in twisted-pair channels, such as is used with 
Gigabit Ethernet, gigabit cthcrnct, linear equalization 
often does not perform well enough to be practical. 

Figure 8 shows a decision feedback equalizer 800. 

10 Decision feedback equalizer 800 includes a feedforward 
feed - forward section 810, a feedback section 811 and an 
adder 804. Feedforward section 810 includes delays 
801-1 through 801-M coupled in series, multipliers 802- 
1 through 802-M coupled to receive the output signals 

15 from delays 801-1 through 801-M, respectively, 

multiplier 802-0 coupled to receive the input sample to 
decision feedback equalizer 800, and an adder 803 
coupled to receive the output signals from each of 
multipliers 802-0 through 802-M. The output signal 

20 from each of multipliers 802-0 through 802-M is the 
input signal to that multiplier multiplied by the 
corresponding one of feedforward feed forward 
multiplier coefficients Co through C M . Feedforward 
feed - forward multiplier coefficients C 0 through C M can 

25 be adaptively chosen in order to optimize the 

performance of the equalizer. In Figure 5B, for 
example, coefficient update 506-j adaptively chooses 
equalizer coefficients to optimize the performance of 
receiver 501-j . 

30 Adder 803 (Figure 8) sums the output signals from 

each of multipliers 802-0 through 802-M. Feedforward 
section 810, therefore, executes the transfer function 



T = C 

FF 



+ 



+ CjZ~ 



+ 



+ c M z 



(9) 



-28- 



612675 v3 



The output signal from feedforward section 810, 
therefore, is given by 

< = C 0 y k + C x y k _ x + - + Cjy k _j + • • • + C M y k _ M , (10) 

where y k -j is the input sample to equalizer 800 during 

5 the (k-j)th time period- Again, the wire designation 

has been neglected for simplicity and it is understood 

that each of receivers 501-1 through 501-N (Figure 5) 

includes an equalizer 505-1 through 505-N, 

respectively, any of which can be a decision feedback 

10 equalizer 800 (Figure 8) . 

One embodiment of feedback section 811 includes 

delays 805-1 through 805-P coupled in series. 

Multipliers 806-1 through 806-P are coupled to receive 

the corresponding output signals from delays 805-1 

15 through 805-P, respectively- Multipliers 806-1 through 
806-P multiply each of their input signals by the 
corresponding one of feedback multiplier coefficients Bi 
through Bp, respectively. Feedback coefficients Bi 
through B P also can be adaptively chosen- Adder 807 

20 sums the output signals from each of multipliers 806-1 
through 806-P. Feedback section 811, therefore, 
executes the transfer function 

T FB =B X Z~ X + B 2 Z~ 2 + ... + B P Z P . (11) 

The Because the input signal to feedback section 811 is 
2 5 symbol a k . Consequently, the output signal from 
feedback section 811 is given by 

< = + B i S k-2 + ■ " + B N a k . p . (12) 
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A second embodiment of feedback section 811, which 
is later discussed in this disclosure, is shown as 
feedback section 1905 in Figure 19 and includes look-up 
table 1906. 

5 The output signal a' ' k from feedback section 811— 

a 1 1 4eT is subtracted from the output signal a' k from 
feedforward section 8 10 7 — ar*-*— in adder 804 . The input 
signal to slicer 8 08 , then, is given by 

a?=a' k -a'{. (13) 

10 Slicer 808 outputs the symbol a k that is closest to the 
input signal a'*'*. 

A decision feedback equalizer operates on the 
principle that if the past transmitted data is 
correctly detected, then the IS1 effects of these past 

15 data symbols can then be canceled from the currently 
received sample. As such, often feedforward section 
810 often contains no multipliers (i.e., C 0 = 1 and all 
other coefficients are 0) and output sample a\ equals = 
-y^T — fefee input sample y k . 

20 Past detected data samples contain no noise and 

therefore decision feedback equalizers do not suffer 
from noise enhancement. However, decision feedback 
equalizers do suffer from the effects of error 
propagation. If slicer 808 erroneously decides a 

25 previous symbol, the error will be propagated into 
subsequent decisions . 

Figure 9 shows the equalization and decoder 
sections ( see, for example, equalizers sec Equalizers 
505-1 through 505-N 505 4 and decoder 507 of Figure 5A 

30 for the case in which N is 4) Figure 5, — for example) of 
a 4-D receiver a 4 D receiver 910. The equalization is 
accomplished using four decision feedback equalizers, 
one for each of the four input channels shown. Again, 
one skilled in the art will recognize that a receiver 

35 can have any number of input channels and that a 4-D 
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receiver is shown here for example only. In Figure 9, 
receiver 910 includes 4-D decoder 900. Although 
decoder 900 is shown as a parity Parity code decoder, 
it is understood that decoder 900 can be any 4-D 
5 decoder. One skilled in the art will recognize that 4- 
D decoder 900 must correct symbols within a single 
clock cycle so that the results can be fed back through 
feedback sections (or taps) FB tapo 811-1 through 811-4 
to correct symbols a' k ,i through a' k ,4, respectively. 

10 The equalization for channel 104-1, for example, 

is accomplished by feedforward section (or tap) 810-1, 
feedback section 811-1, and adder 804-1. Similarly, 
ch annels 104—2 through 104—4, each includes the 
corresponding ones of feedforward sections (or taps) 

15 tapo 810-2 through 810-4, respectively, feedback 

sections 811-2 through 811-4, respectively, and adders 
804-2 through 804-4, respectively. 

Samples y k ,i through y k/4 originate from receiver 
input signals received from channels 104-1 through 104- 

20 4, respectively. Samples y k ,i through y k , 4 are received 
into feedforward taps 810-1 through 810-4, 
respectively. The symbol outputs a' k ,i through a' k , 4 from 
decoder 900, a-*- ^ through a 1 ^— corresponding to a 
single 4-D symbol, are input to feedback taps 811-1 

25 through 811-4, respectively.. As was discussed with 
relation to Figure 8, the output signal signals a' ' k , i 
through a'' kf4 from each of feedback sections 811-1 
through 811-4, a-*-*-^ through a 1 ' 4^-4— respectively, is 
subtracted from the corresponding one of the output 

30 signals a' k ,i through a' k/4 from feedforward sections 810- 
1 through 810-4, a-*-^ through a 1 respectively, in 
each of adders 804-1 through 804-4, respectively. The 
output signals a"'k ( i through a''' k#4 from adders 804-1 
through 804-4, a f 1 1 ^ through a 1 ' respectively, are 

35 inputted to decoder 900. 
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In an embodiment where decoder 900 is a 4-D parity 
code decoder, the input signals a''' k ,i through a'" k , 4 to 
decoder 900 900, — a ! 1 1 ^ through a' ' ' 4^4— are received by 
slicers 901-1 through 901-4, respectively. Each of 
5 slicers 901-1 through 901-4 decides on an output symbol 
symbol, a k ,i through a k , 4 , respectively, based on its 
corresponding input signal signal , a''' k/ i through a"\ r 4, 
respectively. The output symbols from slicers 901-1 
through 901-4 are inputted to parity check 903 and 

10 final decoder 905. 

Parity check 903 sums the 1-D symbols t**e — H> 
symbol s a k ,i through a k , 4 and determines whether the 4-D 
symbol the — 4D symbol is of even parity or odd parity. 
In parity coding using PAM-5 symbols, the 4-D symbol 

15 trhe — 4D symbol is chosen from an even subset and 

therefore each 4-D symbol each 4 D symbol includes an 
even number of 1-D PAM-5 symbols from family X (odd 
parity) and an even number from family Y (even parity) . 
Therefore, the sum of the 1-D PAM-5 symbols is even. 

20 If the parity of the 4-D symbol is even, then final 

decoder 905 then outputs the symbols a k ,i through a k/4 as 

output symbols a' k ,i through a' k , 4M , respectively . 

Error signals e k/1 through e k , 4 are calculated in 

adders 902-1 through 902-4, respectively, by, in each 

25 of the transport channels, taking the difference 

between the output symbol a k/i through a k#4 of slicers 

901-1 through 901-4, ar^, through a ^— respectively, and 

the corresponding one of the input signal signals , 

a"' k ,i through a'" k/4/ respectively: 

30 e ki ^al-a kJ , i=l, 2, 3 or 4. (14) 

The error signals e k ,i through 3 kf4 at each of slicers 
901-1 through 901-4 , respectively, are input to error 
analysis 904. Error analysis 904 determines which of 
the symbols a k/i through a k , 4 is associated with the 
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largest error signal e k ,i through e k; 4, respectively, and 
the sign of the largest error. Error analysis 904 
outputs an identifier W of the symbol having the 
largest absolute error 7 — Wy- and the sign SGN of that 
5 error 7 — SGN, to final decoder 905. If the parity signal 
indicates odd parity, the erroneous symbol is most 
likely to be the one with the largest error, indicated 
by identifier W. Final decoder 905, then, adjusts the 
symbol having the largest error up or down the symbol 

10 alphabet by one symbol depending on the sign SGN (in 
this example, up if the sign is positive and down if 
the sign is negative) and outputs the resulting 4-D 
output symbol defined by a' k/ i through a' k , 4 . 

The combination of N-D trellis code encoding with 

15 a DFE architecture requires a DFE on all four wires for 
each state within the trellis (see, e.g., Figure 3). 
The DFE output at a particular state is used for 
parallel branch decisions and branch metric computation 
for the branches leaving that state. The equalization 

20 in this situation uses a process called "per survivor 
processing", described more fully in Riccardo Raheli, 
Andreas Polydoros, Ching-Kai Tzou, "Per-Survivor 
Processing: A General Approach to MLSE in Uncertain 
Environments," IEEE Trans. Commun., Vol. 43, No. 2/3/4, 

25 pp. 354-364, February/March/April 1995, incorporated by 
reference in its entirety, to determine the feedback 
symbols . 

The multiple decision feedback equalizers in the 
trellis decoder helps to minimize the effects of error 

30 propagation. However, a DFE architecture suffers from 
the disadvantage that it does not utilize the sample 
power contained in the intersymbol interference caused 
by the dispersion in the channel. More particularly, 
information about a 1-D symbol being transmitted during 

35 a time period k is contained in future received 1-D 
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symbols from that channel and DFE does not utilize this 
signal power in deciding the currently received symbol. 

A third type of equalization, sequence detection, 
does not suffer the performance degradation of either a 
5 linear equalizer or a decision feedback equalizer. 
However, a typical sequence detector produces hard 
outputs that can severely limit the performance of an 
error correction code. According to the present 
invention, a soft-output sequence detector is provided. 

10 As an example, Figure 10 shows a portion of a 4-D 

receiver utilizing sequence detection according to the 
present invention. The receiver shown in Figure 10 
includes sequence detectors 1001-1 through 1001-4, one 
for each of the four transmission channels 

15 corresponding to wires 103-1 through 103-4. One 

skilled in the art will recognize that a receiver can 
include any number N of transmission channels, each of 
the transmission channels providing signals to one of N 
detectors. Some or all of the N detectors can be 

20 sequence detectors. 

The output samples a k ,i through a k , 4 from sequence 
detectors 1001-1 through 1001-4, et^^ through 
respectively, along with the second best output samples 
samples, a2 k/ i through a2 k , 4 and 7 — and the errors Ai 

25 through A 4 are input to decoder 1002. Decoder 1002 
decides on the receiver output samples o amp leg , a k/ i 
through a' k/4 based -, — baocd on, for example, the parity 
coding scheme or the N-D lattice coding scheme. One 
skilled in the art will recognize that the decision of 

.30 decoder 1002 can be based on any coding scheme that can 
correct errors in one clock cycle. Feedback is 
provided to sequence detectors 1001-1 through 1001-4 so 
that future sequences are decided using the results of 
the N-D decisions. 

35 Figure 11A shows a block diagram of a sequence 

detector 1100 for the PAM-5 symbol alphabet, {A}={+2, 
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+1, 0, -1, -2}, where the intersymbol interference 

includes the effects of only one other symbol, i.e., 

the ISI length 8 is one (1) . In general, sequence 

detector 1100 can utilize any alphabet and any number 

5 of ISI symbols (A>2 and 8>1) . Detector 1100 includes a 

branch metric generator Branch Metric Generator 1101, 

an add-compare- select Add - Comparc - Select (ACS ) unit 

1102, traceback circuitry Traccback Circuitry 1103, a 

last-in- first-out Last- In- First Out (LIFO) buffer 1104, 

10 and a starting point determiner 1105. Sequence 

detectors are discussed in U.S. Patent Application Ne-r- 

08/974, 459 , cited above. 7 — "Detection for Digital 

Communication Receivers," to Srccn Raghavan, — which has 

been previously incorporated by reference — in this 

15 application . 

The ISI addressed by the embodiment of detector 

1100 shown in Figure 11A Figure 11 is caused by just 

one previously transmitted symbol . Thus, the input 

sample to sequence detector detectors 1100 is given by 

2 0 r kw = a kw + a x a k _ Xw + h kw , (15) 

where where, a i/W is the equalizer ISI coefficient, h k/W 
is the noise component of the output signal from the 
linear filter over a wire over wire w and a k/W is the 
transmitted symbol over wire w received in time period 

25 k. The sequence detector estimates the transmitted 
data sequence {a k ,„} from the sequence of received 
samples {r k/W }. 

The state S k , w of detector 1100 The state of 
detector 1100, — S*^,— is defined as the past data symbol 

30 estimates. In general, a system with a symbol alphabet 
having A symbols and which suffers intersymbol 
interference from 8 previous symbols will have A 6 
possible states. Each state corresponds to a possible 
transition path through the 8 previous symbols. For 

35 example, a system using a symbol alphabet with two 
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symbols, {A} = {+1, -1}, and suffering ISI from two 
past symbols, 8=2, will have four possible sequence 
states of the system: symbol +1 at time k-2 and symbol 
+1 at time k-1; symbol +1 at time k-2 and symbol -1 at 
5 time k-1; symbol -1 at time k-2 and symbol +1 at time 
k-1; and symbol -1 at time k-2 and symbol -1 at time k- 
1. Sequence detector 1100 for the example embodiment 
shown in Figure 11A, a PAM-5 symbol alphabet with ISI 
resulting from one symbol, has five states +2, +1, 

10 0, -1, and -2 -- corresponding to the five symbols in 
the PAM-5 alphabet {A} . 

A trellis diagram depicting a state transition 
from time (k-1) to time k for sequence detector 1100 is 
shown in Figure 12. A trellis diagram provides a 

15 graphical mechanism for predicting what the signal 

output would be for the channel in transitions from one 
state in time k-1 to another state at time k. As an 
example, from Equation 15 above, and neglecting noise, 
a transition from state +2 at time k-1 to a state +1 at 

20 time k results in a signal input to sequence detector 
1100 of l + 2oc W/ i. 

In sequence detector 1100 shown in Figure 11A, 
branch a branch metric generator 1101 generates 
distance metrics corresponding to the branches 

25 illustrated in the trellis diagram of Figure 12. The 
distance metrics represent the difference between the 
input signal r k/ w to branch metric generator 1101 1101, 
^^t-wt- and the calculated signal that is expected to be 
observed in each of the allowed transitions of a 

30 trellis diagram. In general, if there are A states of 
sequence detector 1100, 1100 then there are A 6+1 branch 
metrics to calculate. In some embodiments, however, 
not all branches are allowed and therefore the number 
of branch metrics is reduced. 

35 For PAM-5 signaling suffering from one ISI symbol, 

there are twenty five (25) distance metrics M k , w . The 
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twenty five (25) distance metrics generated by branch 
metric generator 1101 for the case where ISI is the 
result of one past symbol and neglecting random noise 
( i.e. , i.e. A=5, 5=1 and f w '(z) = l+a^iz" 1 ) are given by: 

5 



Mk,w 


(0) = 


[r k ,„- ( 


-2-2oCw,i) ] 2 ; 


M k ,„ 


(13) 


= [r k ,„ 


- (a„,i) ] z ; 


M]c,„ 


(D = 


[r k , w - ( 


-2-aw.i) ] ; 


M k ,„ 


(14) 


= [r k( „- 


(2a w ,0 ] 2 ; 


M k/W 


(2) = 


[r k/W - ( 
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M k ,„ 
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M k ,„ 
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M k ,« 
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M k , w (12) = [r k , w ] 2 . (16) 



20 Other metrics which represent the difference 

between the input symbol and the predicted input 
symbols, assuming each of the possible state 
transitions, may be used as distance metrics. In 
general, there will be a distance metric for every 

25 transition from any state S' at time k-1 to state S at 
time k, A 6+1 distance metrics for a metrics system with 
A symbols and 5 interfering symbols if all transitions 
are allowed. PAM-5 symboling is shown here only as an 
example and embodiments of detector 1100 can utilize 

30 other symbol alphabets and more ISI symbols. 

Add-compare-select (ACS) circuit 1102 in Figure 
11A updates a state metric , denoted by Pk,w(+2), 
Pk,w(+1)/ Pk,w( + 0)/ Pk,w(~l), and p k .w(-2) in the PAM-5 
example, for each possible state of the system Gyotcm, 

35 denoted by p^( + 2), p M (H); p^( i O), p^ ( 1), and 

Pitr+A — 3-) — in the PAM - 5 example, at each time step k. For 
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the PAM-5 symbol alphabet the state metrics are given 
by: 

p k ,w(i) = min jaa{ - 2 , -i, 0,1,2} (Pk-i, w (j ) +M k , w ( ( j +2 ) +5 ( ±+2 ) } ; 
5 for i={2, 1,0, -1,-2}. (17) 

In general, the state metrics represent the 
accumulated distance metrics of past states along 
transition paths that minimize the accumulated distance 

10 metric. Therefore, the transition metric p k/W (S) for 
state S at time period k period k, — ( S ) , is the 
accumulated distance metric for previous states along a 
transition path which ends at state S at time period k, 
state S being one of the possible states of the system. 

15 At time k-1, the state of the system may be at any 

state S 1 in the group of possible states of the system. 
Therefore, Pk,w(S) is the minimum one of Pk-i,w(S ! ) plus 
the distance metric for transition from S f to S. A 
mathematical proof that this technique results in the 

20 least detection error is given in the Appendix of 

"Improved Detection for Digital Communication 

Rcccivcro, " U.S. Patent Application Ne-=- 08/974, 450_^ 

cited above . 

In the example of Figure 11A, the comparison 

25 results rcsulto, D k , w (+2), D k , w ( + 1), D k , w (0), D k , w (-1) and 
Dk /W (-2 ) ©4* r w-( — 2-Hr are stored in a memory of traceback 
circuit 1103 for each of the five states. The 
comparison results indicate the state at time period k- 
1 which results in the state metric p kfW (S) for state S 

30 at time period k . In the PAM-5 , 5=1 example shown in 

Figure 11A, the ACS results for each of the five states 
are given by 

D k/W (±)=j if Pk,w(i) = Pk-i,w(j)+M kfW ((j+2)+5(i+2) ); 
for ±={2,1,0,-1,-2}; j = { 2 , 1 , 0 , -1 , -2 } . (18) 
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In general, D k#w (S) points toward the state S' at time 
k-1 from which results the lowest state metric for 
arriving at state S at time k. 

When it is time for decoding, traceback circuit 
1103 traces back from a starting state, and fetches the 
data from memory in traceback circuit 1103. 

In one example of a traceback, if the traceback 
depth is 2*TB, then it is expected that a traceback of 
TB is performed every TB/2 sample times and traceback 
circuit 1106 outputs TB/2 data symbols. With little 
loss of generality, TB can be an even integer such as 
6, 8 or 16. A greater traceback depth will result in 
less error in determining the final sequence of 
symbols. Greater traceback depths, however, incur an 
implementation cost of requiring more memory in 
traceback circuit 1103. 

During the traceback procedure, starting a- 
otarting state determiner 1105 picks the starting 
state, which can be based on the state metrics p k#w (S) . 
P^-r-w ( s ) - Traceback circuit 1103 1105 follows the 
sequence back through the comparison results stored in 
memory in traceback circuit 1103. The earliest TB/2 
symbols, which result in the earliest states, are 
written into last-in-first-out (LIFO) buffer 1104. The 
new comparison results are stored in the memory 
locations previously occupied by the outputted results. 

Traceback circuit 1103 determines the optimum 
sequence of symbols based on the state metrics p k/W (S) 
stored -P^-rW ( o ) stored in starting state determiner 1105. 
Starting state determiner 1105 initializes the 
traceback procedure by setting a starting sequence. 

LIFO 1104 simply time-reverses the data coming out 
of traceback circuit 1103 because the traceback is 
performed from the current time to previous times. 
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Sequence Detection with Pre-Equalization 

When the channel ISI length 8 is large, or if the 
5 transmitted symbol alphabet size A is large, the above 
method of full sequence estimation becomes impractical 
at high symbol rates. Full sequence estimations 
require the implementation of A 8 states in the detector. 
Accordingly, equalizer an equalizer 1110 can provide 

10 pre-equalization by preprocessing the input samples y k , w 
samples y^w in order to reduce the number of ISI 
symbols to be processed by sequence detector 1100. 
Equalizer 1110 can be any equalizer that reduces the 
number of ISI symbols. Again, for purposes of example, 

15 assume that the channel input alphabet size is A=5, 
i.e., i.e. {A}={+2, +1, 0, -1, -2}, and that the 
reduced ISI length (as seen by the sequence detector) 
is S'=l. As before, the technique is applicable to 
larger alphabets and may accommodate more than one 

20 interfering symbol in the reduced length. 

The output of the equalizer 1110 with A=5 and 5'=1 

is, analogous to Equation 15, ao previously described, 

given by 

rk,w=a k ,w+a w ,i*a k _i, w +h k/W , (19) 

25 where cc w ,i is the equalized ISI coefficient and h k is the 
noise component of the output of the linear equalizer 
1110. The transfer function (in Z-transform notation, 
see Sec A. V. Oppenheim and R.W. Schafer, Discrete-Time Signal 
Processing, (1989)) for equalizer 1110 is then given iey- 

30 then, — given by 

E w (z) = (l+a W/1 z" 1 ) /f w (z) . (20) 

The coefficient a W/ i is chosen to minimize the noise 
variance at the output of the equalizer. Equalizer 
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1110, therefore, is a reduced sequence equalizer 
because it reduces the ISI length from 8 to 6'. The 
reduced ISI length 8' is one (1) in this example. 

In one embodiment, reduced sequence equalizer 1110 
5 is implemented adaptively. One architecture used for 
adaptive implementation is shown in Figure 11B. In 
this embodiment, equalizer 1110 includes a linear 
equalizer 1120 implementing a transfer function C(Z) = 
1/f (Z) = C 0 + CiZ" 1 G±— ^ + . . . + C 5 Z" 8 , adaptively 

10 followed by a filter 1121 implementing the function 
(l+oc w ,iZ l + cx ^^-z- + . . . +oc w ,5'Z ). By implementing 
both equalizer 1120 and filter 1121 adaptively, optimal 
performance can be achieved for any cable length. 
Linear equalizer 1120 can be adaptively implemented by 

15 using the least mean squares (LMS) algorithm ( see Sec 
E.A. Lee and D.G. Messerchmitt, Digital Communications (1988)) 
and a finite impulse response filter as shown in Figure 
6. 

The coefficients cc w ,i through a W/ g' can be chosen 

20 adaptively in the sequence detector by observing the 
frequency response of linear equalizer 1120. From 
linear equalizer 1120, the channel frequency response 
is deduced and a w ,i through a W/ 5' can be selected from a 
look-up table. In one embodiment with 8'=1, two 

25 possible values of oc W/ i (0 and 1/2) are used. One of 
the two possible coefficients is chosen for oc w ,i by 
observing the two largest equalizer coefficients of 
linear equalizer 1120, C 0 and Ci- For example, in one 
embodiment, embodiments if Ci/C 0 < -0.5 then a Wfl = 0.5, 

30 otherwise a w ,i = 0. 

The benefits of combining linear equalization with 
sequence detection include (a) reduced complexity in 
the sequence detector, especially for large ISI 
lengths, and (b) reduced noise enhancement in the 

35 linear equalization. 
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In the example described in connection with Figure 
11B ii with 5'=1, the number of states in the sequence 
estimator is reduced from 5 to 5. The reduced state 
sequence estimator can be implemented using the Viterbi 
5 algorithm. 

Sequence Detection with Pre-equalizat ion and Decision 
Feedback 

10 Figure 13 shows a receiver 1350 that includes an 

embodiment of a sequence detector 1300 having decision- 
feedback. In this embodiment, equalizer 1301, which as 
before can be any equalizer structure, pre-equalizes 
transmission channel 104-w to a pre-determined ISI 

15 polynomial G w (z) of length r|<5, where 8 is the ISI 

length of the frequency response f w (z) of response — # w -f-Z-)- 
o# transmission channel 104-w. In one example, the 
example of Figure 11, r| is 2 and the ISI polynomial 
G w (z) is given by 

20 G w (z) = 1 + a w/ iz _1 + a W/2 z -2 . (21) 

The transfer function of equalizer 1301 is given by 

E w (z) = G w (z) /f w (z) . (22) 

25 Sequence detector 1300 includes branch metric 

generator 1302, add compare select (unit ) 1303, 
traceback ( circuit ) 1304, LIFO 1305 and starting point 
determiner 1306. In general, the detection technique 
implemented in sequence estimator 1300 may be used for 

30 any combination of 5 and r| such that r|<5. Although the 
technique may be implemented with any sized alphabet, 
the example shown in Figure 13 is for the PAM-5, (A=5) , 
alphabet. The coefficients, a w ,i and a w , 2 , can be chosen 
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adaptively to optimize performance of the receiver 
1350. 

To perform the sequence estimation using the 
Viterbi algorithm, as outlined above, sequence detector 
5 1300 is still implemented with twenty five states (if 
the data symbols are PAM-5 values) . The branch metric 
computations from a trellis diagram now accounts for 
the intersymbol interference due to the symbols 
transmitted two sample times before as well as the 
10 symbol transmitted during the last period. In one 
embodiment, the branch metrics computed by branch 
metric generator 1302 with decision feedback are given 
by: 
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M k , w ( 22 ) = [ r k , w -ot w , 2 D k _! ( 0 ) -2 ] 2 ; 

Mk, w ( 2 3 ) = [ r k , w -a w , 2 D k _i ( 1 ) - ( 2 +a w , i ) ] 2 ; 

M k , w ( 2 4 ) = [ r k , w -a w , 2 D k -i ( 2 ) - ( 2 +2a w , ± ) ] 2 . (23) 

5 

The ISI due to the transmitted symbol at time (k- 
2) is removed from the received sample r k/W before the 
branch metric of the sequence detector that accounts 
for the ISI due to the transmitted symbol at time (k-1) 

10 is computed. After this calculation, the previously 
described calculation is performed to remove the ISI 
due to the (k-l)th transmitted symbol. 

Add compare select (ACS) 1303 then computes the 
state metrics p k/W (j) and the comparison results D k#w (j) 

15 as described above in Equations 17 and 18, cquationo — 1-6 
and 17, respectively. Traceback 1304 accepts a 
starting point from starting point determiner 1306, as 
described above for the corresponding components of 
sequence detector 1100 in Figure 11A , and outputs a set 

20 of decided-on decided on symbols to LIFO 1305. LIFO 
1305, then, outputs the resulting symbols in reverse 
chronological order from that received. 

Sequence Detection detection in Combination combination 
2 5 with Error Correction error correction 

Although achieving excellent noise margins, the 
combination of sequence detection with error correction 
codes is problematic. Sequence detectors usually 

30 produce hard decisions (i.e., decisions that do not 

contain information on reliability) , which become input 
signals to error correcting codes. Most error 
correcting techniques, such as the parity coding or 4-D 
lattice coding proposed for. Gigabit Ethernet, rely on 

35 soft decisions (i.e., decisions that contain 

reliability information) to achieve full performance. 
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See, e.g., S. Lin and D. J. Costello, Jr., Error Control 
Coding: Fundamentals and Applications (1983) . Thus, a typical 
sequence detector in combination with a decoder using 
an error correcting code does not achieve the improved 
5 SNR margins of both the sequence detector and the error 
correcting code unless the decoder is provided with a 
soft decision from the sequence detector. 

Figure 14 shows a sequence detector 1400-w 
according to the present invention. Sequence detector 

10 1400-w is coupled to receive signal r k/W from wire w. 
Sequence detector 1400-w includes branch metric 
generator 1402-w, add compare select (unit ) (ACS) 1403- 
w, and starting point determiner 1406-w. Add compare 
select 1402-w and starting point determiner 1406-w are 

15 each coupled to traceback 1404. 

Traceback 1404 is coupled to each wire w so that 
the traceback can be accomplished on N-D symbols rather 
than performing a separate traceback on N 1-D symbols, 
where N is the number of wires. Traceback 1404 is also 

20 coupled with LIFO 1405. LIFO 1405 outputs the final 
symbol stream a' k ,„ for each wire w. 

A Although a sequence detector according to the 
present invention can accommodate any symbol alphabet 
and any number of ISI symbols. For example, symbols , 

25 for example sequence detector 1400 shown in Figure 14 
is for a PAM-5 alphabet where input signals suffer the 
influence of one past ISI symbol (i.e., the ISI length 
is 1) . As occurs with equalizer 1110 in Figure 11A 
(see Equation 20), equalizer 1401-w Equalizer 1401 - w, 

30 as has been previously discussed, executes a transfer 
function E(Z) = ( l+a w , iZ _1 ) /f w ( Z ) and therefore sequence 
detector 1400-w detects a signal that includes ISI from 
one past symbol. Branch metric generator 1402-w 1 4 02 - 
w-r therefore generates the -branch metrics as described 

35 in Equation 16. 
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Add compare select (ACS ) 1403-w computes the 
state metrics p kfW (i) (i=-2, -1, 0, 1, 2) according to 
Equation 17 and the ACS results D k , w (i) according to 
Equation 18. Additionally,, ACS 1403-w computes a 
5 second best state metric p2 k , w (i), a second ACS result 
D2 k/W (i), and a difference result A k , w (i). The second 
best state metric can be computed according to the 
equation 

P 2 k t w(t)= second minimum (p k -i,w(j) + M k , w ( 5 ( i + 2 ) + ( j +2 ) ) ) ; 
10 j={-2, -1, 0, 1, 2}, (24) 

where i={-2, -1, 0, 12}. The second ACS result can be 
computed according to 

D2 k w (0 = j if p2 k w (/) = p k _ l w (/) + M kiW (5(/ + 2) + U + 2)) , (25) 

where i= { -2 , -1 , 0 , 1 , 2 } and j= (-2 , -1, 0, 1, 2 } . Finally, 
15 the difference result can be computed according to 

^^(0 = ^2^(0-^^(0 . (2 6) 

Traceback 1404 receives the ACS results, the second ACS 
results, and the difference results from each state on 
each wire as well as a starting point signal from 

20 starting point determiner 1406-w for each wire w. 

Figure 15 shows an embodiment of of a 4-D 
traceback 1404 for use in combination with a series of 
sequence detectors 1400-w. . For It io understood that, 
in general, — £e*r an N-wire configuration, traceback 1404 

25 is generally coupled into N sequence detectors similar 
to that shown in Figure 14, one for each wire w. In 
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Figure 15, traceback 1404 includes a parity code 
decoder 1504 although other coding schemes can be used, 
provided that the coding scheme can correct symbols 
within one clock cycle. 
5 For exemplary purposes, Figure 15 shows a four- 

wire parity-code decoder. Traceback 1404 includes read 
modules a road module 1501-1 through 1501-4, one for 
each of the four wires. Each read Read module 1501-1 
through 1501-4 receives parameters r kfW from add compare 

10 select 1403-w and starting point determiner 1406-w 

(Figure 14). Parameters T k/W includes the add compare 
results D k , w (i), D2 k , w (i) and A k , w (i), where i=(-2, -1, 0, 
1, 2) for PAM-5 signaling, as well as a starting point 
SP k , w for each wire w. As was discussed before, 

15 starting point determiner 1406-w chooses a starting 
point SP k/W , which can be based on the state metrics 
p k/W (i), for traceback 1404 . 

Traceback 1404 in Figure 15 traces back to arrive 
at the best sequence a k/W for wire w. For each clock 

20 cycle k, read module 1501-w arrives at a best symbol 
a k/ w/ a second best symbol a2 k/W and an associated 
reliability e k , w for each wire w. 

As described above, the 4-D parity coding scheme 
only transmits 4-D symbols having even parity. A 

25 single error in one 1-D symbol will cause the parity of 
the 4-D symbol to become odd. Similar to "4-D 
slicing", traceback 1404 recognizes the parity error 
and makes corrections to the four 1-D to the — 4 — 1 — 9 
symbols from read modules 1501-1 through 1501-4 for 

30 clock cycle k based on the reliability of each of the 
1-D symbols. 

Hagenauer has shown that, within a Viterbi 
decoder, the reliability of decision symbol paths 
merging at each state grows with the difference between 

35 the state metrics between the two paths. See J. 

Hagenauer and P. Hocher, "A Viterbi Algorithm with 
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Soft-Decision Outputs and its Applications, 11 Proc. 
GLOBECOM '89, 1680-1686, November 1989. 1989) . Similar 
to Hageauer's Soft Output Viterbi Algorithm (SOVA) , 
each of read modules 1501-1 through 1501-4 outputs the 
5 difference metric, i.e., i.e. the reliability measure, 
between the best two paths entering each state, s k/ i 
through e k , 4 , respectively. SOVA uses these metrics 
over a range of sample times within the trellis to 
output soft decisions for every symbol. 

10 However, 4-D parity traceback 1404 can recognize 

when a single error occurs. Therefore, only the 
difference metrics at the time of the error are 
required to correct errors. Because the actual 
decoding is accomplished during traceback in each of 

15 sequence detectors 140-1 through 140-4, traceback 1404 
recognizes an error in its .channel and corrects the 
error in its own sequence path. 

For each clock cycle k, traceback 1404 retrieves 
each of the first choice 1-D symbols Sk,i through a k , 4 , 

20 the second choice 1-D symbols a2 k ,i through a2 k , 4 , and 

the reliability measures s k/i through e k/4 , and determines 
the finally decided four 1-D decided — 4 — 1 — 9 symbols a' k ,i 
through a' k , 4 . 

For each clock cycle k, parity check 1502 receives 
25 the first choice symbols a k ,i through a kf4 from read 

modules 1501-1 through 1501-4, respectively, determines 
the parity of the resulting 4-D symbol and outputs a 
parity signal indicating the parity of the 4-D symbol. 
Error analysis 1503 receives reliability measures e k ,i 
30 through 8 k/4 from read modules 1501-1 through 1501-4, 
respectively, determines which of the sequence 
detectors w has the least reliability, thereby 
indicating which result is most likely to be incorrect, 
and outputs a wire signal W indicating which symbol is 
35 most likely to be incorrect. Decoder 1504 receives the 
first choice symbols a kf i through a k/4 , the second choice 
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symbols a2 k/i through a2 k/4 , the parity signal from 
parity check 1502, and the wire signal from error 
analysis 1503. 

If the parity signal indicates that the parity of 
5 the first choice 4-D symbol is even, then the first 
choice symbols a k ,i through a k , 4 are output as the 
finally decided symbols a' k ,i through a' k/4 . However, an 
odd parity indicates an error in one of the first 
choice symbols a k/ i through a k/4 . If the parity signal 

10 indicates an odd parity, the symbol indicated by the 
wire signal W is replaced by a corresponding one of 
second choice symbols a2 k ,i through a2 k , 4 and the 
resulting 4-D symbol is output as finally decided 
symbols a' k ,i through a' k/4 . 

15 Additionally, decoder 1504 informs read modules 

1501-1 through 1501-4 of the finally decided symbols 
a k/ i through a' k , 4 by indicating, for each of read 
modules 1501-1 through 1501-4, which of the first 
choice symbols or the second choice symbols was output 

20 as the finally decided symbols for clock cycle k. Read 
modules 1501-1 through 1501-4 can then traceback 
accordingly and output the first choice symbols, second 
choice symbols, and reliability measures for clock 
cycle k-1 (i.e., a k -i,i through a k _i, 4 , a2 k _i,i through a2 k _ 

25 1,4, and e k -i,i through s k _i, 4 , respectively). 

In other words, read module 1501-w outputs the 
best possible step back a k/W , the second best step back 
a2 k/W , and the reliability measure e k/W for each wire for 
clock cycle k. Parity check 1502 performs a parity 

30 check on the best possible step back a k/W . Error 

analysis 1503 determines the wire most likely to be 
incorrect. If the parity passes, decoder 1504 outputs 
the best possible step back a k , w for clock cycle k. If 
parity fails, then decoder 1504 replaces one of the 

35 best possible symbols with the associated second best 
symbol, based on which wire is most likely to be 
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incorrect, and outputs the resulting 4-D symbol. The 
choice of best symbol or second best symbol for each 
wire w is communicated back' to read module 1501-w so 
that read module 1501-w can use the appropriate symbol 
5 to step back to clock cycle k-1. The replacement 
choice then — then, affects only one read module. 
Therefore, the next set of symbols will be affected in 
one read module only. 

As shown in Figure 14, the output symbols a' k , w are 
10 output to LIFO 1405, which time reverses the order of 
the symbol stream and outputs the resulting symbol 
stream a\, w . 

One skilled in the art will recognize that in 
general a sequence detector according to this invention 
15 can accommodate any symbol alphabet and the effects of 
any number of ISI symbols. Additionally, the sequence 
detector may include decision feedback as shown in 
Figure 13. 

20 

Reduced Complexity Sequence Detection Using State 
Reduction 

25 

If the alphabet size is large or if the ISI length 
at the sequence detector is large then sequence 
detector 1400-w shown in Figure 14 and traceback 1404 
using parity coding shown in Figure 15 become 

30 impractical at high symbol rates. The number of states 
required in read modules 1501-1 through 1501-4 is A 71 on 
each wire, where A represents the number of symbols in 
alphabet {A} and r\ represents the ISI symbol length at 
the sequence detector ( i.e., i.e. at the input terminal 

35 of sequence detector 1400 in Figure 14). With a PAM-5 
alphabet and r\=2 ISI symbols, each of read modules 
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1501-1 through 1501-4 requires twenty five (25) states 
in order to perform sequence detection. A decoder 
utilizing a large number of states is expensive, 
difficult to implement, and consumes a lot of power. 
5 Figure 16 shows a sequence detector 1600-w having 

reduced complexity sequence detection. In particular, 
sequence detector 1600-w includes branch metric 
generator 1602-w, add-compare-select (unit) 1603-w, and 
starting point determiner 1605-w. Traceback 1604 and 

10 LIFO 1606 are coupled into sequence detector 1600-2 as 
well as similar detectors coupled to the remaining N 
wires. As an example, sequence detector 1600-w is 
shown for the PAM-5 alphabet, although embodiments of 
sequence detector 1600-w can utilize other symbol 

15 alphabets as well. 

As mentioned above, the The PAM-5 symbol alphabet 
can be segregated into two families, an odd family X 
having the PAM-5 symbols {-1, +1} and an even family Y 
having the PAM-5 symbols {-2, 0, +2}. A detector state 

20 can now be defined as the previous r\ families X or Y, 
as opposed to the previous r| PAM-5 symbols {-2, -1, 0, 
+1, +2}. Therefore, the number of states required for 
the PAM-5 symbol alphabet with r\=2 ISI symbols is 
reduced from 25 states to 4 states on each transmission 

25 channel w=l through L. For a four wire system (4-D 
decoding, for example) , there are a total of sixteen 
(16) states instead of one hundred (100) states. 

Reduced state detection can be accomplished when 
the minimum squared distance between any two parallel 

30 branches of a state transition S— >S f exceeds the minimum 
squared distance between any two paths in the trellis. 
A parallel branch refers to transitions S— >S' between 
individual states through different symbols. For 
example, a state S = X can transition to a state S' = X 

35 through receipt of either a -1 symbol or a +1 symbol. 



-51- 



612675 v3 



The actual squared minimum distance between 
sequences does not decrease and thus the performance 
suffers little or no degradation from that of full 
state sequence detection. Gigabit Ethernet using a 
5 PAM-5 symbol set suffering .ISI from two (2) symbols 
meets this criteria. 

Figure 17 shows a trellis diagram displaying the 
reduced state transitions and all parallel PAM-5 
transitions. In Figure 17, a state is represented by 

10 two consecutive symbols (reflecting an ISI length of 

2). A transition from state S at time k-1 to state S' 
at time k has two or three parallel branches, depending 
upon whether the new symbol entering at state S' is in 
family X or family Y. For example, a transition from 

15 state XX at time k-1 to state XX at state k has two 

branches because the incoming symbol must be either a - 
1 or +1 PAM-5 symbol. A transition from state XX at 
time k-1 to a state XY at time k, however, indicates 
that either a -2, 0 or +2 symbol is received and 

20 therefore there are three branches. 

In Figure 16, equalizer 1601-w can execute the transfer 
function 

E (Z) = (l+a i Z^+asZ" 2 ) / f (Z) ■ frfZ^ ( 1 i a ±^he^-&~^ ) /f ( z ) . 

25 (27) 

Therefore, the expected signal input to decoder system 
1600 is 

rk,w = ak,w+ocia k -i, w +a2ak-2, w - 28 ) (27 ) 

30 

Branch metric generator 1602-w computes the branch 
metrics for the state transitions displayed in Figure 
17. In the reduced state trellis shown in Figure 17, 
branch metric 1602-w first .decides on which of the two 
35 or three branches of the transition from state S to 
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state S' to assign to the state transition S— >s' . The 

decision of which branch performs the S— >s' transition 

is based on calculating a distance metric for each 

branch and choosing the branch having the lowest 

5 metric. For example, in the transition from state S=XX 

to state S'=XX branch metric generator first determines 

which of the two branches (-1 or +1) are traversed 

before calculating the metric. The decision of which 

branch is traversed is stored in branch decision 

10 Bk fW (S— »S'). The branch decision and the metric are both 

communicated to ACS 1603-w. 

For each state S at k-1, symbols a k -i(S)and a k - 2 (S) 

are known based upon feedback from ACS 1603-w to branch 

metric generator 1602-w Branch Metric Generator — 1602 - W, 

15 as es — ie— shown in Figure 16. For each state transition 

S — > S 1 , branch metric generator takes the difference 

between the input signal and the ISI portion of 

Equation 28 Equation 27 to obtain a difference 

a(S->S') = r kfW - aia k -i, w (S) - a 2 a k _ 2 , w ( S ) . (29) 4**f 

20 The difference a is then compared with the symbols for 

each possible branch of the state transition S to S f . 

The symbol a 1 k , w (S^-S 1 ) chosen for the branch branch, 

Br^^t ( S > S ' ) , is then assigned to the transition from 

state S to state S'. 
25 With reference to As — ins — shown in Figure 18 , the 

The branch metrics can be computed for each transition 

S to S 1 according to the equation: 

M k , w (S->S') = [r k , w - a' k , w (S->S' )- 

a x a k -i f „ (S) - a 2 a k _ 2 ,w(S) ] 2 , (30) -f^j- 

30 where the valid transitions (S->S ! ) in Figure 18 are 

S^S ! = XXX, XXY, YXX, YXY, XYX, XYY, YYX and YYY . The 
notation "ABC" used above and in Figure 18, where each 
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of "A", "B" and "C" is X or Y, on Figure 18 indicates 

an S-^S 1 transition from S=AB to S 1 =BC . 

Add-compare-select 1603-w receives the branch 

metrics M k , w ((S^S f ) and branch decisions B k/W (S^S') 
5 from branch metric generator 1602-w and calculates the 
state metrics P k , w (S') according to the equation 

P k/W (S l ) - min j={s} (P k , 1/W ( j) + .M k , w (S->S' ) ) , (31) W 

where j is equal to each S .such that S— >S 1 is allowable. 
Add-compare-select 1603-w also determines the ACS 

10 results for each of the four final states S' and 

communicates those results to traceback circuit 1604. 
The ACS result D k/W (S') is the path resulting in state 
S' having the lowest metric M(S— »S'). Because there are 
only two allowed paths that result in state S' (see 

15 Figures 17 and 18), the second best choice is 

automatically the path that is contraindicated by 
Dk,w(S') and need not be separately stored. 

The error A k , w (S') is the difference in metrics 

between the two paths resulting in state S ! : 
20 A k/W (S') = |m(Si-»S' ) -M(S 2 ->S" ) | , (32) 

where Si is one of the two initial states that 
transition to the final state S ? and S 2 is the other of 
the two initial states that transition to the final 
state S'. For example, from Figure 18, if S ! =YX, then 

25 Si and S 2 are the states XY . and YY, respectively. 

Finally, the branch decisions of branch metric 
generator 1602-w are also communicated to traceback 
circuit 1604. Branch decision Bl k , w (S') corresponds to 
the decision on the path S— »S' indicated by D k , w (S'). 

30 Branch decision B2 kfW (S /r ) corresponds to the decision on 
the path S— »S' contraindicated by D k#w (S f ). Therefore, 
in the soft-decision process, if the traceback circuit 
1604 is altered to the second most likely path, the 
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parallel path decision for the second most likely path 
is available to traceback circuit 1604. 

Traceback circuit 1604 can be the same as 
traceback 1404 of Figure 15 except that read modules 
5 1501-1 through 1501-4 receive a different set of 
parameters r k , w . In traceback circuit 1604, r k/W 
includes the ACS parameters D k/W (Si), A k/W (Si), Bl k/W (Si), 
B2 k ,„(Si), where Si = (XX, XY, YX, YY) , and the starting 
point SP kfW from starting point determiner 1605-w. As 

10 described above, read modules 1501-1 through 1501-4 
store the ACS results in memory and, starting from 
starting point SP k/W determined by starting point 
determiner 1605, determine determines the most likely 
symbol a k , w and the second most likely symbol a2 k/W for 

15 clock cycle k. A reliability An reliability measure 
s k , w indicating the difference in distance metrics 
between the most likely symbol and the second most 
likely symbol symbol , — e^^— is also determined. 

As is shown in Figure 15, read modules 1501-1 

20 through 1501-4 output the parameters a k/W to parity 

check 1502 and decoder 1504, parameters a2 k , w to decoder 
1504, and parameters e k , w to error analysis 1503. As 
was previously discussed, decoder 1504 outputs the 
outputs — a the best symbols a' k/W based on the parity 

25 check and informs read modules 1501-1 through 1501-4 of 
the choice. Read modules 1501-1 through 1501-4 then 
proceed to determine most likely and second most likely 
symbols for clock cycle k-1 until the traceback is 
complete . 

30 In sequence detector 1600-w of Figure 16, the 

minimum squared distance between parallel branches of 
any transition S^-S ' should be at least twice as large 
as the minimum squared distance of the overall decoder. 
Because there is no protection between parallel branch 

35 decisions S^S" of decisions — S > S" — a# sequence 

detector 1600-w, this requirement on minimum squared 
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distances should hold true in order to prevent the 
overall minimum distance from decreasing because of 
reduced state detection. 

As was previously discussed, the 4-D parity code 
5 provides 3 dB of coding gain, which doubles the squared 
minimum distance between possible paths. However, this 
code provides no protection between parallel branches 
of transitions along one wire. Therefore, this overall 
requirement on minimum distances prevents the minimum 
10 squared distance from decreasing because of reduced 
state detection. This requirement holds for Gigabit 
Ethernet standards, as described above. Although the 
requirement should hold in general, it may not be held 
for all embodiments of the '.invention . 

15 

Simplified DFE 

Reduced sequence detection can also be 

accomplished utilizing decision feedback equalization 

20 (DFE). However, a simplified DFE provides a simple and 

easy implementation for accomplishing the equalization 

process in the allotted time (8 ns in the example of 

gigabit transmission over four wires). 

Figure 19 shows an example of a simplified 

25 decision feedback equalizer 1900. The simplified 

decision feedback equalizer includes a pre-equalizer 
section 1901, an adder 1902, a slicer 1903, and a 
feedback section 1905. delays 190 4 and 1905, and 
oclcctor 1906. Pre-equalizer section 1901 can be any 

30 equalizer structure that reduces the ISI length to L 
symbols. Pre-equalizer section 1901, therefore, 
executes the transfer function 

T(Z) = ! — — L - , ' (33) 433* 
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where oti through ot L are the multiplier coefficients of 
pre-equalizer section 1901 and f(Z) is the response of 
the input channel (see Equation 2 for the response of a 
transfer channel) . 
5 The output signal a 1 k from from pre-equalizer (or 

feedforward) feedforward section 1901 1901 , — a- 1 -*— is 
input to adder 1902. Adder 1902 subtracts the signal 
a 1 1 k from selector 1906 1906, — a-^^— from the output 
signal a 1 k from feedforward section 1901 . 1902 , — a-H— 

10 The resulting signal a llf )c = a'k ~ a ' ! k signal, — a 1 1 ' ^ = 

a-^-a ' - is input to slicer 1903. Slicer 1903 outputs 
a symbol a k that is closest . to the input signal a ,?, k . 
The feedback section 1905 (see also feedback section 
811 of Figure 8) of decision feedback equalizer 1900 

15 comprises delays 1904-1 and 1904-L 190 4 and 1905 and 
selector 1906. Selector 1906 receives each of L past 
symbols a k _i through a k _ L and uses these symbols to 
access a lookup table. The, lookup table holds values £i 
through £ Q . The output signal a 1 1 k of selector 1906 

20 1906, — a-*-*-*— then is that one of £i through £q that 

corresponds to the combination of inputs a k -i through a k _ 
l • The time required to look the results up in a look- 
up table is much less than the time required to perform 
the L mulltiplications multiplies and L additions 

25 required of the feedback section shown, for example, as 
feedback section 811 of Figure 8. 

In some embodiments, selector 1906 receives the 
look-up values £i through ^ Q as input signals. In some 
embodiments, the look-up values £i through ^ Q are 

30 preset. The look-up values £i through § Q can also be 
adaptively chosen to optimize performance of the 
receiver of which decision .feedback equalizer 1900 is a 
part. In most embodiments, Q = A L where A is the size 
of the symbol alphabet. 

35 As an example, in a system using the PAM-5 

alphabet where L=2, and Q is 25 there are twenty-five 
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(25) lookup values (i.e., Q=25) . Because the 
intersymbol interference in the input signal to adder 
1902 is the result of two (2) ISI symbols, 

a' k = a k + ota k _i + pa k _ 2 + n k/ - (34) (33) 

5 where a and P are the interference parameters and n k is 
random noise. The twenty-five values for the look-up 
table, therefore, are given by: 
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The parameters a and P can be adaptively chosen 
and the table updated periodically by calculating the 
look-up values through £ Q an< 3 inputting them into 
5 selector 1906. When decision feedback equalizer 1900 
is utilized, for example, as equalizer 505-j in 
receiver 501-j of Figure 5B, look-up values through 
§ Q can be calculated by coefficient update 506-j and 
read into equalizer 505-j . 

10 Figure 20A shows a sequence detector 2000. 

Sequence detector 2000 can be any sequence detector 
system having feedback, including sequence detector 
1300 (Figure 13) and sequence detector 1600 (Figure 
16) . As before, sequence detector 2000 utilizes any 

15 symbol alphabet and includes trellis decoding for any 
number of past ISI symbols. 

Pre-equalizer section 2001 of sequence detector 
2000 receives signal y^wr and executes a transfer 
function, such as that shown in Equation 33, Equation 

20 32 , that removes the ISI influence from all but L past 
symbols. Feedback section 2003 outputs a signal a''^ 
that removes the influence from an additional M past 
symbols based on the inputs from the ACS. Sequence 
detector 2000 therefore utilizes 7 — therefore, — utilize 

25 states describing the past L-M ISI symbols. Figure 12, 
for example, illustrates a trellis diagram for L-M = 1. 
Figures 17 and 18, for example, illustrate a trellis 
diagram for a reduced state sequence detector with L-M 
= 2. . 

30 As occurs in branch metric generators 1101, 1302, 

1402-w, and 1602-w, woo — described before, branch metric 
generator 2004 outputs a set of branch metrics M k (S->S') 
for transitions between states S and state S 1 of the 
decoder. ACS 2005 outputs the ACS results to traceback 

35 circuitry 2006, and the transition metrics to starting 
point 2007. Traceback circuit 2006 outputs the symbols 
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decided by sequence detector 2000, in reverse 
chronological order, and LIFO 2008 reverses the order 
of those symbols to output symbol stream a k/W . 

The output signals S k , w - outputted from ACS 2005 to 
5 feedback section 2003 are given by the traced back 
sequence from traceback circuit 2006. 

From Figure 20A, Figure 20, if the past L symbols 
have been properly decoded than the influence of 
intersymbol interference will be completely canceled. 

10 In general, feedback section 2003 can be any feedback 
structure. An example feedback section is feedback 
section 811 shown in Figure 8. Feedback section 811, 
however, includes M multipliers (multipliers 806-1 
through 806-M) and an M-input adder (adder 807) for the 

15 case of M ISI symbol cancellation. 

One embodiment of feedback section 2003 includes 
feedback sections like feedback section 811. For 
Gigabit Ethernet, at symbol rates of 125 Mhz on each 
wire, the timing constraints of the sequence detector 

20 are severe. When "per-survivor processing" (see, e.g., 
sequence detector 1300 of Figure 13) is used , feedback 
feed - back section 2003 must- include feedback section 
811 repeated for each state of equalizer 2000 because 
the final state of equalizer 2000 is not determined 

25 until the latest decision of ACS 2005 (i.e., the 
parameters S k , w are determined by ACS 2005) . 

Figure 20B shows an embodiment of feedback section 
2003 that includes a look-up feedback section 2100. 
Look-up feedback section 2100 outputs an output signal 

30 a f, k from look-up values ^ through ^ Q in response to the 
ACS parameters S k _i through S k - L . Look-up values §i 
through ^ Q can be preloaded into feedback section 2100 
or may be periodically adaptively chosen and read into 
feedback section 2100. Values for look-up values 

35 through ^ Q for two ISI symbols and a PAM-5 symbol 

alphabet are given above in Equation 35. Equation 3 4 . 
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